Jul 16 21:37:02.178112 ip-10-0-142-10 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 21:37:02.178122 ip-10-0-142-10 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 21:37:02.178129 ip-10-0-142-10 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 21:37:02.178340 ip-10-0-142-10 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 21:37:12.200903 ip-10-0-142-10 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 21:37:12.200919 ip-10-0-142-10 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c12cf595a9c64ef99a1a61e0bcf61a95 --
Jul 16 21:38:53.490996 ip-10-0-142-10 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 21:38:53.884191 ip-10-0-142-10 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:38:53.884191 ip-10-0-142-10 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 21:38:53.884191 ip-10-0-142-10 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:38:53.884191 ip-10-0-142-10 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 21:38:53.884191 ip-10-0-142-10 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 21:38:53.884918 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.884242    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 21:38:53.890438 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890415    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:38:53.890438 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890434    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:38:53.890438 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890438    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:38:53.890438 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890442    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:38:53.890438 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890445    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:38:53.890438 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890448    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890451    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890454    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890457    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890460    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890463    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890465    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890468    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890470    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890474    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890478    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890482    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890484    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890487    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890490    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890492    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890495    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890497    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890500    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:38:53.890661 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890503    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890505    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890508    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890510    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890513    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890515    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890518    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890520    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890523    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890525    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890528    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890530    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890533    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890536    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890539    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890541    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890544    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890547    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890550    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890552    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:38:53.891127 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890554    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890557    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890559    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890562    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890564    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890566    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890569    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890571    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890573    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890576    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890578    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890580    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890583    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890585    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890588    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890591    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890594    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890598    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890602    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:38:53.891616 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890605    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890609    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890612    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890614    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890618    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890622    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890625    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890628    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890631    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890634    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890637    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890640    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890642    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890645    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890648    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890650    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890653    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890655    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890658    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890660    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:38:53.892090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890664    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890666    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890669    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890672    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890675    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890677    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890680    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890682    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890684    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890706    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890709    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890712    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890715    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890717    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890719    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.890722    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891406    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891411    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891414    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:38:53.892562 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891417    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891422    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891424    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891427    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891430    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891432    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891435    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891438    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891440    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891443    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891446    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891448    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891451    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891454    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891458    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891460    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891463    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891465    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891468    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:38:53.893027 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891470    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891472    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891475    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891477    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891479    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891481    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891484    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891486    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891489    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891491    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891494    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891496    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891499    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891501    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891504    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891507    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891509    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891511    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891514    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891516    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:38:53.893485 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891519    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891521    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891524    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891526    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891531    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891534    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891537    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891540    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891547    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891550    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891552    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891555    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891557    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891560    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891563    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891566    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891568    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891570    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891573    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:38:53.894001 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891575    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891578    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891580    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891582    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891585    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891588    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891591    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891593    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891596    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891598    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891601    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891603    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891607    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891611    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891614    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891616    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891619    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891621    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891624    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891626    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:38:53.894467 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891629    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891631    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891635    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891637    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891640    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891642    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891645    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891648    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891651    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891653    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891657    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891660    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891663    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891666    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891668    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891671    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891674    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.891677    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892064    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892070    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:38:53.894980 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892072    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892075    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892077    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892080    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892084    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892086    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892089    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892091    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892094    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892096    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892099    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892102    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892105    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892107    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892110    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892113    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892116    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892118    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892121    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892123    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:38:53.895478 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892126    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892128    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892133    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892136    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892138    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892140    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892143    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892145    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892148    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892150    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892153    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892156    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892158    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892161    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892163    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892166    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892168    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892171    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892173    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892177    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:38:53.895973 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892179    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892182    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892184    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892186    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892189    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892192    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892194    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892199    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892201    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892204    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892206    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892209    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892211    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892213    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892218    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892222    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892225    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892228    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892231    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:38:53.896570 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892234    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892237    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892240    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892242    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892245    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892247    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892249    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892252    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892254    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892257    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892259    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892261    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892265    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892268    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892270    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892272    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892275    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892277    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892280    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:38:53.897051 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892282    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892286    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892289    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892292    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892294    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892296    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892299    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892302    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892305    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892307    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892310    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892312    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892315    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892317    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892320    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892322    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892326    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892329    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.892332    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892409    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 21:38:53.897511 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892420    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892428    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892434    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892440    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892444    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892448    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892452    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892455    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892458    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892461    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892464    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892467    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892470    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892474    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892477    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892481    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892484    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892488    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892491    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892494    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892498    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892501    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892505    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 21:38:53.898046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892508    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892511    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892514    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892517    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892520    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892523    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892526    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892529    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892533    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892536    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892538    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892541    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892544    2563 flags.go:64] FLAG: --enable-server="true"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892546    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892550    2563 flags.go:64] FLAG: --event-burst="100"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892553    2563 flags.go:64] FLAG: --event-qps="50"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892556    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892559    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892561    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892565    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892568    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892571    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892577    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892580    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892583    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 21:38:53.898597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892586    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892589    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892592    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892595    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892598    2563 flags.go:64] FLAG: --feature-gates=""
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892601    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892604    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892608    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892610    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892613    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892616    2563 flags.go:64] FLAG: --help="false"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892619    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-142-10.ec2.internal"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892622    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892624    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892627    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892630    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892633    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892636    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892638    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892641    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892643    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892646    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892649    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892651    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 16 21:38:53.899265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892654    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892656    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892659    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892662    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892664    2563 flags.go:64] FLAG: --lock-file=""
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892668    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892671    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892674    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892679    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892682    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892684    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892707    2563 flags.go:64] FLAG: --logging-format="text"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892711    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892714    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892717    2563 flags.go:64] FLAG: --manifest-url=""
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892720    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892725    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892728    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892732    2563 flags.go:64] FLAG: --max-pods="110"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892735    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892738    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892741    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892743    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892746    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892749    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 21:38:53.899867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892751    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892759    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892762    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892765    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892767    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892770    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892775    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892778    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892781    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892783    2563 flags.go:64] FLAG: --port="10250"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892786    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892789    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aee14d7813577917"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892794    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892796    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892799    2563 flags.go:64] FLAG: --register-node="true"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892802    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892806    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892809    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892811    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892814    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892818    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892821    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892823    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892826    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892828    2563 flags.go:64] FLAG: --runonce="false"
Jul 16 21:38:53.900467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892831    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892834    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892837    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892839    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892842    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892844    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892847    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892850    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892853    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892855    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892858    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892860    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892863    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892866    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892868    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892873    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892876    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892878    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892883    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892887    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892889    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892892    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892894    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892897    2563 flags.go:64] FLAG: --v="2"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892901    2563 flags.go:64] FLAG: --version="false"
Jul 16 21:38:53.901094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892910    2563 flags.go:64] FLAG: --vmodule=""
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892913    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.892916    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893025    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893029    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893034    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893038    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893041    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893043    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893046    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893049    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893052    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893054    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893057    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893059    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893061    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893064    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893066    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893069    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:38:53.901717 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893071    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893074    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893076    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893078    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893081    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893083    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893085    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893089    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893091    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893094    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893096    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893099    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893101    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893105    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893109    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893113    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893116    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893119    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893122    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:38:53.902192 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893125    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893127    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893130    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893133    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893135    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893138    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893141    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893143    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893145    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893148    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893150    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893153    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893155    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893158    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893160    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893162    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893165    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893167    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893170    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:38:53.902706 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893172    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893176    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893178    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893180    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893183    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893185    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893188    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893192    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893195    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893198    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893200    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893202    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893205    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893207    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893209    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893212    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893214    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893217    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893219    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893221    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:38:53.903157 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893224    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893226    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893229    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893231    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893233    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893236    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893238    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893241    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893243    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893245    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893248    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893250    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893252    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893256    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893259    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893261    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893265    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893283    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893286    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:38:53.903627 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893291    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893294    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893297    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893300    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893303    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.893305    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.894036    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.901737    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.901753    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.901771    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.901776    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901832    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901837    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901841    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901844    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:38:53.904094 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901846    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901849    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901852    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901854    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901857    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901860    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901863    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901865    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901868    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901870    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901872    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901875    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901877    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901880    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901882    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901885    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901887    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901890    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901892    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901895    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:38:53.904464 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901898    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901900    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901903    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901907    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901910    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901914    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901917    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901921    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901925    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901928    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901942    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901945    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901948    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901951    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901953    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901956    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901959    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901961    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901964    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:38:53.904969 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901966    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901968    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901971    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901973    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901976    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901979    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901981    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901983    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901986    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901988    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901990    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901993    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901995    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.901998    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902001    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902004    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902007    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902009    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902012    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902015    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:38:53.905430 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902018    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902020    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902022    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902025    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902027    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902030    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902032    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902035    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902037    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902039    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902041    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902044    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902047    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902049    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902052    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902054    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902057    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902059    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902061    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902064    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:38:53.906040 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902066    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902070    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902074    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902077    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902079    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902083    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902085    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902089    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902091    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902094    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902096    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902099    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902101    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902104    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902106    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:38:53.906524 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902108    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.902113    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902246    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902251    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902255    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902258    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902261    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902264    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902267    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902269    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902272    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902275    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902277    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902280    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902282    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 21:38:53.906915 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902284    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902287    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902289    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902292    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902295    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902299    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902302    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902305    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902307    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902310    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902313    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902316    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902319    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902322    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902325    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902327    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902329    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902332    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902335    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902337    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 21:38:53.907276 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902339    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902342    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902344    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902346    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902349    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902351    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902353    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902355    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902358    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902360    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902362    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902365    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902367    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902369    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902372    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902374    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902376    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902379    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902382    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902384    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 21:38:53.907761 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902387    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902389    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902391    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902394    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902397    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902399    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902402    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902404    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902407    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902409    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902412    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902415    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902417    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902419    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902422    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902424    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902427    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902429    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902431    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 21:38:53.908235 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902434    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902436    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902440    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902443    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902445    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902448    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902450    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902453    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902455    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902458    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902460    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902463    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902465    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902468    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902470    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902473    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902475    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902478    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902481    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902483    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 21:38:53.908704 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902486    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902488    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902490    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902493    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902495    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902497    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:53.902500    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.902505    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.902600    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.904541    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.905760    2563 server.go:1019] "Starting client certificate rotation"
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.905861    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.905893    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 21:38:53.909204 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.909102    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 21:38:53.913084 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.913064    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 21:38:53.924658 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.924638    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 16 21:38:53.926769 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.926753    2563 log.go:25] "Validated CRI v1 image API"
Jul 16 21:38:53.928218 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.928205    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 21:38:53.930443 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.930424    2563 fs.go:135] Filesystem UUIDs: map[4dd7ff89-3c18-4019-a015-33064f0a2891:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ad3ff74a-c9e1-4ef3-a44a-c430a7456c2b:/dev/nvme0n1p3]
Jul 16 21:38:53.930513 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.930441    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 21:38:53.935254 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.935143    2563 manager.go:216] Machine: {Timestamp:2026-07-16 21:38:53.934041521 +0000 UTC m=+0.325933360 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104245 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2485fc5e930741204325d12d9f9242 SystemUUID:ec2485fc-5e93-0741-2043-25d12d9f9242 BootID:c12cf595-a9c6-4ef9-9a1a-61e0bcf61a95 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a9:fd:db:45:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a9:fd:db:45:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:ad:62:f3:f8:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 21:38:53.935254 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.935245    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 21:38:53.935358 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.935347    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 21:38:53.936332 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.936308    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 21:38:53.936455 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.936335    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-10.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 21:38:53.937040 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.937030    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 21:38:53.937076 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.937042    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 21:38:53.937076 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.937049    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 21:38:53.938366 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.938349    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 21:38:53.938610 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.938598    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 21:38:53.941010 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.940999    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 21:38:53.943903 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.943892    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 21:38:53.944009 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.944000    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 21:38:53.944041 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.944030    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 21:38:53.944041 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.944040    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 21:38:53.944099 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.944053    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 21:38:53.944099 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.944062    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 16 21:38:53.944099 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.944071    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 21:38:53.944587 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.944448    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 21:38:53.944652 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.944598    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 21:38:53.946678 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.946663    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 21:38:53.948487 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.948473    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 21:38:53.948537 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.948505    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 21:38:53.949901 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949890    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 21:38:53.949963 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949906    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 21:38:53.949963 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949913    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 21:38:53.949963 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949919    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 21:38:53.949963 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949927    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 21:38:53.949963 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949941    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 21:38:53.949963 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949950    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 21:38:53.949963 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949955    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 21:38:53.949963 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949962    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 21:38:53.949963 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949967    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 21:38:53.950189 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949980    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 21:38:53.950189 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.949986    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 21:38:53.951376 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.951366    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 21:38:53.951376 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.951375    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 21:38:53.954425 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.954411    2563 server.go:1268] "Started kubelet"
Jul 16 21:38:53.954507 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.954478    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 21:38:53.954807 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.954510    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 21:38:53.954907 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.954829    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 21:38:53.955221 ip-10-0-142-10 systemd[1]: Started Kubernetes Kubelet.
Jul 16 21:38:53.957815 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.957791    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 21:38:53.958863 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:53.958833    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 21:38:53.958957 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.958825    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-10.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 21:38:53.959126 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:53.959095    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 21:38:53.959956 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.959936    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 21:38:53.960096 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:53.960075    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 21:38:53.967099 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.967082    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 21:38:53.967186 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.967096    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 21:38:53.967294 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:53.967273    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:53.967673 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.967654    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 21:38:53.967766 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.967703    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 21:38:53.967766 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.967715    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 21:38:53.967859 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.967823    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 21:38:53.967859 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.967831    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 21:38:53.968097 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.968073    2563 factory.go:55] Registering systemd factory
Jul 16 21:38:53.968097 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.968092    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 16 21:38:53.968358 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.968342    2563 factory.go:153] Registering CRI-O factory
Jul 16 21:38:53.968358 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.968358    2563 factory.go:223] Registration of the crio container factory successfully
Jul 16 21:38:53.968479 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.968405    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 21:38:53.968479 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.968427    2563 factory.go:103] Registering Raw factory
Jul 16 21:38:53.968479 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.968438    2563 manager.go:1196] Started watching for new ooms in manager
Jul 16 21:38:53.969339 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.969324    2563 manager.go:349] Starting recovery of all containers
Jul 16 21:38:53.976988 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:53.976961    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 21:38:53.977092 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:53.977069    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 21:38:53.978142 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:53.976976    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-10.ec2.internal.18c2e2f29820b0e8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-10.ec2.internal,UID:ip-10-0-142-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-10.ec2.internal,},FirstTimestamp:2026-07-16 21:38:53.954380008 +0000 UTC m=+0.346271849,LastTimestamp:2026-07-16 21:38:53.954380008 +0000 UTC m=+0.346271849,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-10.ec2.internal,}"
Jul 16 21:38:53.979273 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.979257    2563 manager.go:354] Recovery completed
Jul 16 21:38:53.984029 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.984018    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:38:53.986204 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.986178    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:38:53.986267 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.986222    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:38:53.986267 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.986234    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:38:53.986806 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.986788    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 21:38:53.986806 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.986805    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 21:38:53.986923 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.986818    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:38:53.986923 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.986823    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 21:38:53.987462 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.987446    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:38:53.987519 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.987477    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:38:53.987519 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.987489    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:38:53.987994 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.987983    2563 policy_none.go:49] "None policy: Start"
Jul 16 21:38:53.988026 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.987997    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 21:38:53.988026 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.988007    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 21:38:53.988976 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:53.988965    2563 policy_none.go:47] "Start"
Jul 16 21:38:53.995787 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:53.995721    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-10.ec2.internal.18c2e2f29a0648c9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-10.ec2.internal,UID:ip-10-0-142-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-10.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-10.ec2.internal,},FirstTimestamp:2026-07-16 21:38:53.986203849 +0000 UTC m=+0.378095690,LastTimestamp:2026-07-16 21:38:53.986203849 +0000 UTC m=+0.378095690,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-10.ec2.internal,}"
Jul 16 21:38:54.008081 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.008020    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-10.ec2.internal.18c2e2f29a06a6e1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-10.ec2.internal,UID:ip-10-0-142-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-10.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-10.ec2.internal,},FirstTimestamp:2026-07-16 21:38:53.986227937 +0000 UTC m=+0.378119777,LastTimestamp:2026-07-16 21:38:53.986227937 +0000 UTC m=+0.378119777,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-10.ec2.internal,}"
Jul 16 21:38:54.017069 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.016915    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-10.ec2.internal.18c2e2f29a06cd3e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-10.ec2.internal,UID:ip-10-0-142-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-10.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-10.ec2.internal,},FirstTimestamp:2026-07-16 21:38:53.986237758 +0000 UTC m=+0.378129598,LastTimestamp:2026-07-16 21:38:53.986237758 +0000 UTC m=+0.378129598,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-10.ec2.internal,}"
Jul 16 21:38:54.023271 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.023259    2563 manager.go:337] "Starting Device Plugin manager"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.023293    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.023302    2563 server.go:87] "Starting device plugin registration server"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.023500    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.023511    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.023593    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.023671    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.023679    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.024205    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.024244    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.027718    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-10.ec2.internal.18c2e2f29a0648c9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-10.ec2.internal.18c2e2f29a0648c9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-10.ec2.internal,UID:ip-10-0-142-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-10.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-10.ec2.internal,},FirstTimestamp:2026-07-16 21:38:53.986203849 +0000 UTC m=+0.378095690,LastTimestamp:2026-07-16 21:38:53.987463382 +0000 UTC m=+0.379355226,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-10.ec2.internal,}"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.036887    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-10.ec2.internal.18c2e2f29a06a6e1\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-10.ec2.internal.18c2e2f29a06a6e1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-10.ec2.internal,UID:ip-10-0-142-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-10.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-10.ec2.internal,},FirstTimestamp:2026-07-16 21:38:53.986227937 +0000 UTC m=+0.378119777,LastTimestamp:2026-07-16 21:38:53.987482472 +0000 UTC m=+0.379374314,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-10.ec2.internal,}"
Jul 16 21:38:54.040922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.038258    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h692b"
Jul 16 21:38:54.045365 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.045303    2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-10.ec2.internal.18c2e2f29a06cd3e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-10.ec2.internal.18c2e2f29a06cd3e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-10.ec2.internal,UID:ip-10-0-142-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-10.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-10.ec2.internal,},FirstTimestamp:2026-07-16 21:38:53.986237758 +0000 UTC m=+0.378129598,LastTimestamp:2026-07-16 21:38:53.987494236 +0000 UTC m=+0.379386082,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-10.ec2.internal,}"
Jul 16 21:38:54.049604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.049588    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h692b"
Jul 16 21:38:54.054986 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.054933    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-10.ec2.internal.18c2e2f29c626563  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-10.ec2.internal,UID:ip-10-0-142-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-142-10.ec2.internal,},FirstTimestamp:2026-07-16 21:38:54.025794915 +0000 UTC m=+0.417686741,LastTimestamp:2026-07-16 21:38:54.025794915 +0000 UTC m=+0.417686741,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-10.ec2.internal,}"
Jul 16 21:38:54.099194 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.099160    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 21:38:54.100447 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.100426    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 21:38:54.100558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.100466    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 21:38:54.100558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.100492    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 21:38:54.100558 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.100530    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 21:38:54.110494 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.110472    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:38:54.124412 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.124396    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:38:54.125128 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.125112    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:38:54.125230 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.125147    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:38:54.125230 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.125162    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:38:54.125230 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.125191    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.133784 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.133769    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.133865 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.133792    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-10.ec2.internal\": node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:54.164418 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.164372    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:54.201589 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.201569    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal"]
Jul 16 21:38:54.201651 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.201625    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:38:54.203111 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.203097    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:38:54.203167 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.203124    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:38:54.203167 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.203135    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:38:54.204439 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.204427    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:38:54.204553 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.204538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.204594 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.204576    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:38:54.205133 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.205118    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:38:54.205205 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.205145    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:38:54.205205 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.205157    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:38:54.205205 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.205156    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:38:54.205205 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.205182    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:38:54.205205 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.205195    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:38:54.206321 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.206307    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.206374 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.206338    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:38:54.207037 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.207024    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:38:54.207095 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.207053    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:38:54.207095 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.207067    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:38:54.231256 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.231235    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-10.ec2.internal\" not found" node="ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.235448 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.235433    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-10.ec2.internal\" not found" node="ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.265024 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.265003    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:54.269307 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.269290    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd8eab11ad85f88519612ac852560a8a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"bd8eab11ad85f88519612ac852560a8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.269370 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.269315    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd8eab11ad85f88519612ac852560a8a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"bd8eab11ad85f88519612ac852560a8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.269370 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.269331    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e0787be98d7ff323b91c421748cde82-config\") pod \"kube-apiserver-proxy-ip-10-0-142-10.ec2.internal\" (UID: \"4e0787be98d7ff323b91c421748cde82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.365840 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.365819    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:54.370141 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.370124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd8eab11ad85f88519612ac852560a8a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"bd8eab11ad85f88519612ac852560a8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.370221 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.370154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd8eab11ad85f88519612ac852560a8a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"bd8eab11ad85f88519612ac852560a8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.370221 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.370179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e0787be98d7ff323b91c421748cde82-config\") pod \"kube-apiserver-proxy-ip-10-0-142-10.ec2.internal\" (UID: \"4e0787be98d7ff323b91c421748cde82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.370311 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.370236    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bd8eab11ad85f88519612ac852560a8a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"bd8eab11ad85f88519612ac852560a8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.370311 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.370292    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4e0787be98d7ff323b91c421748cde82-config\") pod \"kube-apiserver-proxy-ip-10-0-142-10.ec2.internal\" (UID: \"4e0787be98d7ff323b91c421748cde82\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.370382 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.370325    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd8eab11ad85f88519612ac852560a8a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal\" (UID: \"bd8eab11ad85f88519612ac852560a8a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.466637 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.466547    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:54.535089 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.535058    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.540379 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.540355    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:54.567501 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.567465    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:54.667993 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.667953    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:54.768407 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.768346    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:54.868834 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.868805    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:54.873743 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.873724    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:38:54.905802 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.905786    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 21:38:54.906166 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.905897    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 21:38:54.906166 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:54.905940    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 21:38:54.969080 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:54.969056    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:55.053940 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:55.053852    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 21:33:55 +0000 UTC" deadline="2028-03-18 06:23:15.084371027 +0000 UTC"
Jul 16 21:38:55.053940 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:55.053892    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14648h44m20.030484061s"
Jul 16 21:38:55.069132 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:55.069105    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:55.158319 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:55.158296    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 21:38:55.160028 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:55.160010    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 21:38:55.160126 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:55.160041    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 21:38:55.160126 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:55.160050    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeHasSufficientPID"
Jul 16 21:38:55.169393 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:55.169376    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:55.179336 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:55.179318    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:38:55.269676 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:55.269653    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:55.269676 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:55.269643    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0787be98d7ff323b91c421748cde82.slice/crio-00ff941b39327d564a4abe44ce5fbaa7ddd0527fa3aa825398ad885da76c9941 WatchSource:0}: Error finding container 00ff941b39327d564a4abe44ce5fbaa7ddd0527fa3aa825398ad885da76c9941: Status 404 returned error can't find the container with id 00ff941b39327d564a4abe44ce5fbaa7ddd0527fa3aa825398ad885da76c9941
Jul 16 21:38:55.269899 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:55.269884    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8eab11ad85f88519612ac852560a8a.slice/crio-1516c2c9814c826afe03ff1bc639f538faca8c13049cd213fb124cdc966ed088 WatchSource:0}: Error finding container 1516c2c9814c826afe03ff1bc639f538faca8c13049cd213fb124cdc966ed088: Status 404 returned error can't find the container with id 1516c2c9814c826afe03ff1bc639f538faca8c13049cd213fb124cdc966ed088
Jul 16 21:38:55.274501 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:55.274485    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:38:55.369811 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:55.369790    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:55.470529 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:55.470493    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-10.ec2.internal\" not found"
Jul 16 21:38:55.514454 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:55.514429    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:38:55.568348 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:55.568320    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:57.147383 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.147367    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 21:38:57.148934 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.148919    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal"
Jul 16 21:38:57.156496 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.156482    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 21:38:57.287254 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.287177    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:38:57.512283 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.512252    2563 apiserver.go:52] "Watching apiserver"
Jul 16 21:38:57.520783 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.519931    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 21:38:57.520783 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.520333    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-m2cm2","openshift-image-registry/node-ca-chlpb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal","openshift-multus/multus-additional-cni-plugins-gp999","openshift-multus/network-metrics-daemon-h5dfc","openshift-ovn-kubernetes/ovnkube-node-vnf82","kube-system/global-pull-secret-syncer-whqdq","kube-system/konnectivity-agent-gj8cl","kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal","openshift-dns/node-resolver-8bjzh","openshift-multus/multus-bdktj","openshift-network-diagnostics/network-check-target-2sblr","openshift-network-operator/iptables-alerter-84hf2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"]
Jul 16 21:38:57.522088 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.522064    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:57.522198 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.522168    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:38:57.524387 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.524247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.527638 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.527243    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8x7x5\""
Jul 16 21:38:57.527638 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.527269    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 21:38:57.527638 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.527496    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 21:38:57.527638 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.527535    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:38:57.528729 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.528705    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.530281 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.530258    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.531312 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.531289    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 21:38:57.531544 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.531526    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-t7bcb\""
Jul 16 21:38:57.531737 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.531722    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 21:38:57.531991 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.531973    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 21:38:57.532378 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.532343    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 21:38:57.532550 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.532535    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 21:38:57.532885 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.532870    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 21:38:57.533076 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.533059    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 21:38:57.533243 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.533225    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hlz8m\""
Jul 16 21:38:57.533405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.533391    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 21:38:57.534468 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.534448    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 21:38:57.534556 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.534473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:38:57.534556 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.534530    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:38:57.535839 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.535820    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.538019 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.538003    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 21:38:57.538589 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.538569    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:38:57.539615 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.539436    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 21:38:57.539615 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.539467    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 21:38:57.539615 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.539486    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 21:38:57.539809 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.539726    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 21:38:57.539991 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.539891    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 21:38:57.544015 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.540309    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-78kmx\""
Jul 16 21:38:57.544015 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.540743    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 21:38:57.544015 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.543149    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hnks5\""
Jul 16 21:38:57.544015 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.543387    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 21:38:57.544243 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a3fa095-aca5-4943-b6d7-8116aaddae61-iptables-alerter-script\") pod \"iptables-alerter-84hf2\" (UID: \"0a3fa095-aca5-4943-b6d7-8116aaddae61\") " pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.544304 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-socket-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.544304 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-sys-fs\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.544398 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.544398 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37897c5f-4e5e-47a1-890c-010bdeb4877a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.544398 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37897c5f-4e5e-47a1-890c-010bdeb4877a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.544398 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.544398 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-device-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.544627 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-system-cni-dir\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.544627 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-cnibin\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.544627 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37897c5f-4e5e-47a1-890c-010bdeb4877a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.544627 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:38:57.544627 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544486    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdzvp\" (UniqueName: \"kubernetes.io/projected/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-kube-api-access-xdzvp\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:38:57.544627 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21308f42-77e5-4c41-bc85-caa29a85bafa-kubelet-config\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:57.544627 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21308f42-77e5-4c41-bc85-caa29a85bafa-dbus\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:57.544960 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a3fa095-aca5-4943-b6d7-8116aaddae61-host-slash\") pod \"iptables-alerter-84hf2\" (UID: \"0a3fa095-aca5-4943-b6d7-8116aaddae61\") " pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.544960 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-registration-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.544960 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-etc-selinux\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.544960 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plvbf\" (UniqueName: \"kubernetes.io/projected/84166a80-3046-44ef-adb5-46cab1be378f-kube-api-access-plvbf\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.544960 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544843    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-os-release\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.544960 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c5bf\" (UniqueName: \"kubernetes.io/projected/0a3fa095-aca5-4943-b6d7-8116aaddae61-kube-api-access-5c5bf\") pod \"iptables-alerter-84hf2\" (UID: \"0a3fa095-aca5-4943-b6d7-8116aaddae61\") " pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.544960 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mssl8\" (UniqueName: \"kubernetes.io/projected/37897c5f-4e5e-47a1-890c-010bdeb4877a-kube-api-access-mssl8\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.545280 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.544975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:57.546610 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.546584    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.547120 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.547090    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 21:38:57.548112 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.548091    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.549126 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.549102    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 21:38:57.549286 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.549270    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:38:57.549555 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.549539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ls9vj\""
Jul 16 21:38:57.550150 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.550131    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 21:38:57.550703 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.550678    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5m5wl\""
Jul 16 21:38:57.551745 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.551189    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 21:38:57.551745 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.551367    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 21:38:57.553490 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.553473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.554482 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.554463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:38:57.554554 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.554541    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:38:57.554921 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.554903    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.555887 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.555833    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 21:38:57.556117 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.556097    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 21:38:57.556387 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.556215    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wct5n\""
Jul 16 21:38:57.557740 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.557709    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l682l\""
Jul 16 21:38:57.558139 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.558120    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 21:38:57.567828 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.567002    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4glz4"
Jul 16 21:38:57.577504 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.577481    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4glz4"
Jul 16 21:38:57.636019 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.635928    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.645921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21308f42-77e5-4c41-bc85-caa29a85bafa-dbus\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.645973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a3fa095-aca5-4943-b6d7-8116aaddae61-host-slash\") pod \"iptables-alerter-84hf2\" (UID: \"0a3fa095-aca5-4943-b6d7-8116aaddae61\") " pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-os-release\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-cni-netd\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ac8ce73-91e1-4c61-9901-8f1be334b08a-serviceca\") pod \"node-ca-chlpb\" (UID: \"6ac8ce73-91e1-4c61-9901-8f1be334b08a\") " pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c5bf\" (UniqueName: \"kubernetes.io/projected/0a3fa095-aca5-4943-b6d7-8116aaddae61-kube-api-access-5c5bf\") pod \"iptables-alerter-84hf2\" (UID: \"0a3fa095-aca5-4943-b6d7-8116aaddae61\") " pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1342119b-f24e-42e5-8dbb-d456eb1b1277-env-overrides\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-sysconfig\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-modprobe-d\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a3fa095-aca5-4943-b6d7-8116aaddae61-iptables-alerter-script\") pod \"iptables-alerter-84hf2\" (UID: \"0a3fa095-aca5-4943-b6d7-8116aaddae61\") " pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-socket-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-kubelet\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646306    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-slash\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-os-release\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.648129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdzvp\" (UniqueName: \"kubernetes.io/projected/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-kube-api-access-xdzvp\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646397    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-run-ovn\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-cni-bin\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252a0135-3aa3-46d1-94fe-5ea146ff6095-tmp\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-cnibin\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-daemon-config\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mssl8\" (UniqueName: \"kubernetes.io/projected/37897c5f-4e5e-47a1-890c-010bdeb4877a-kube-api-access-mssl8\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-node-log\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646566    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-run-ovn-kubernetes\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-run-netns\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1342119b-f24e-42e5-8dbb-d456eb1b1277-ovnkube-config\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-run\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-var-lib-kubelet\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37897c5f-4e5e-47a1-890c-010bdeb4877a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-kubernetes\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-sysctl-d\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-systemd\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.649109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-host\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-system-cni-dir\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-run-k8s-cni-cncf-io\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58qv7\" (UniqueName: \"kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7\") pod \"network-check-target-2sblr\" (UID: \"1c733e9c-3cc5-4a84-bfb2-9b906456909f\") " pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-device-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37897c5f-4e5e-47a1-890c-010bdeb4877a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.646996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-var-lib-openvswitch\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a-agent-certs\") pod \"konnectivity-agent-gj8cl\" (UID: \"d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a\") " pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-sysctl-conf\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647073    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh7sl\" (UniqueName: \"kubernetes.io/projected/252a0135-3aa3-46d1-94fe-5ea146ff6095-kube-api-access-nh7sl\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-os-release\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.647103    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647107    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21308f42-77e5-4c41-bc85-caa29a85bafa-dbus\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.647200    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret podName:21308f42-77e5-4c41-bc85-caa29a85bafa nodeName:}" failed. No retries permitted until 2026-07-16 21:38:58.147152166 +0000 UTC m=+2.972797444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret") pod "global-pull-secret-syncer-whqdq" (UID: "21308f42-77e5-4c41-bc85-caa29a85bafa") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a3fa095-aca5-4943-b6d7-8116aaddae61-host-slash\") pod \"iptables-alerter-84hf2\" (UID: \"0a3fa095-aca5-4943-b6d7-8116aaddae61\") " pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-socket-dir-parent\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.649930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21308f42-77e5-4c41-bc85-caa29a85bafa-kubelet-config\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647318    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-registration-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-run-netns\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-cni-binary-copy\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-var-lib-cni-multus\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-conf-dir\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647437    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-registration-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-run-openvswitch\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-device-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647460    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21308f42-77e5-4c41-bc85-caa29a85bafa-kubelet-config\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-log-socket\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-socket-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1342119b-f24e-42e5-8dbb-d456eb1b1277-ovnkube-script-lib\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-var-lib-kubelet\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.650764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-hostroot\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/37897c5f-4e5e-47a1-890c-010bdeb4877a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-run-multus-certs\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-sys-fs\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647878    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-systemd-units\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-sys-fs\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.647977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/264493e6-1304-4d77-83e8-dc20b5a46aa2-hosts-file\") pod \"node-resolver-8bjzh\" (UID: \"264493e6-1304-4d77-83e8-dc20b5a46aa2\") " pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xjwb\" (UniqueName: \"kubernetes.io/projected/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-kube-api-access-9xjwb\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648032    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/37897c5f-4e5e-47a1-890c-010bdeb4877a-cni-binary-copy\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-system-cni-dir\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648048    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0a3fa095-aca5-4943-b6d7-8116aaddae61-iptables-alerter-script\") pod \"iptables-alerter-84hf2\" (UID: \"0a3fa095-aca5-4943-b6d7-8116aaddae61\") " pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648092    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-system-cni-dir\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648114    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-cnibin\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/37897c5f-4e5e-47a1-890c-010bdeb4877a-cnibin\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.651502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a-konnectivity-ca\") pod \"konnectivity-agent-gj8cl\" (UID: \"d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a\") " pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-sys\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.648262    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648275    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-tuned\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.648333    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs podName:a9e42f68-4446-40f4-9c44-9e7c96acb2e7 nodeName:}" failed. No retries permitted until 2026-07-16 21:38:58.148314732 +0000 UTC m=+2.973960012 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs") pod "network-metrics-daemon-h5dfc" (UID: "a9e42f68-4446-40f4-9c44-9e7c96acb2e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264493e6-1304-4d77-83e8-dc20b5a46aa2-tmp-dir\") pod \"node-resolver-8bjzh\" (UID: \"264493e6-1304-4d77-83e8-dc20b5a46aa2\") " pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-etc-selinux\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plvbf\" (UniqueName: \"kubernetes.io/projected/84166a80-3046-44ef-adb5-46cab1be378f-kube-api-access-plvbf\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-etc-openvswitch\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ac8ce73-91e1-4c61-9901-8f1be334b08a-host\") pod \"node-ca-chlpb\" (UID: \"6ac8ce73-91e1-4c61-9901-8f1be334b08a\") " pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-lib-modules\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-cni-dir\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648615    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-var-lib-cni-bin\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-etc-kubernetes\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37897c5f-4e5e-47a1-890c-010bdeb4877a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648692    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-run-systemd\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.652265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648717    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1342119b-f24e-42e5-8dbb-d456eb1b1277-ovn-node-metrics-cert\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.653033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648741    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmhz9\" (UniqueName: \"kubernetes.io/projected/6ac8ce73-91e1-4c61-9901-8f1be334b08a-kube-api-access-tmhz9\") pod \"node-ca-chlpb\" (UID: \"6ac8ce73-91e1-4c61-9901-8f1be334b08a\") " pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.653033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648767    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stkfb\" (UniqueName: \"kubernetes.io/projected/264493e6-1304-4d77-83e8-dc20b5a46aa2-kube-api-access-stkfb\") pod \"node-resolver-8bjzh\" (UID: \"264493e6-1304-4d77-83e8-dc20b5a46aa2\") " pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.653033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.648838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxxhz\" (UniqueName: \"kubernetes.io/projected/1342119b-f24e-42e5-8dbb-d456eb1b1277-kube-api-access-xxxhz\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.653033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.649004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/84166a80-3046-44ef-adb5-46cab1be378f-etc-selinux\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.653033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.649648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/37897c5f-4e5e-47a1-890c-010bdeb4877a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.658619 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.658361    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 21:38:57.663133 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.663079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c5bf\" (UniqueName: \"kubernetes.io/projected/0a3fa095-aca5-4943-b6d7-8116aaddae61-kube-api-access-5c5bf\") pod \"iptables-alerter-84hf2\" (UID: \"0a3fa095-aca5-4943-b6d7-8116aaddae61\") " pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.663707 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.663644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plvbf\" (UniqueName: \"kubernetes.io/projected/84166a80-3046-44ef-adb5-46cab1be378f-kube-api-access-plvbf\") pod \"aws-ebs-csi-driver-node-vfljv\" (UID: \"84166a80-3046-44ef-adb5-46cab1be378f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.664222 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.664202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdzvp\" (UniqueName: \"kubernetes.io/projected/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-kube-api-access-xdzvp\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:38:57.664738 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.664715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mssl8\" (UniqueName: \"kubernetes.io/projected/37897c5f-4e5e-47a1-890c-010bdeb4877a-kube-api-access-mssl8\") pod \"multus-additional-cni-plugins-gp999\" (UID: \"37897c5f-4e5e-47a1-890c-010bdeb4877a\") " pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.673188 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.673142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" event={"ID":"4e0787be98d7ff323b91c421748cde82","Type":"ContainerStarted","Data":"00ff941b39327d564a4abe44ce5fbaa7ddd0527fa3aa825398ad885da76c9941"}
Jul 16 21:38:57.675566 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.675542    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" event={"ID":"bd8eab11ad85f88519612ac852560a8a","Type":"ContainerStarted","Data":"1516c2c9814c826afe03ff1bc639f538faca8c13049cd213fb124cdc966ed088"}
Jul 16 21:38:57.750165 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-node-log\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-run-ovn-kubernetes\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-run-netns\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1342119b-f24e-42e5-8dbb-d456eb1b1277-ovnkube-config\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-run\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-node-log\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-run-ovn-kubernetes\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750280    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-run-netns\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-var-lib-kubelet\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-kubernetes\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-run\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750346    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-var-lib-kubelet\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-sysctl-d\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750397    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-kubernetes\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-systemd\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-host\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-system-cni-dir\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-run-k8s-cni-cncf-io\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-systemd\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qv7\" (UniqueName: \"kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7\") pod \"network-check-target-2sblr\" (UID: \"1c733e9c-3cc5-4a84-bfb2-9b906456909f\") " pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-var-lib-openvswitch\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-run-k8s-cni-cncf-io\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-host\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-sysctl-d\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a-agent-certs\") pod \"konnectivity-agent-gj8cl\" (UID: \"d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a\") " pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-sysctl-conf\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-system-cni-dir\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh7sl\" (UniqueName: \"kubernetes.io/projected/252a0135-3aa3-46d1-94fe-5ea146ff6095-kube-api-access-nh7sl\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750688    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-var-lib-openvswitch\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.750869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-socket-dir-parent\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-run-netns\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-socket-dir-parent\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-cni-binary-copy\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-var-lib-cni-multus\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-conf-dir\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-run-openvswitch\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-log-socket\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750845    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1342119b-f24e-42e5-8dbb-d456eb1b1277-ovnkube-config\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1342119b-f24e-42e5-8dbb-d456eb1b1277-ovnkube-script-lib\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750903    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-var-lib-cni-multus\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-var-lib-kubelet\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750963    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-hostroot\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.750962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-run-netns\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-run-multus-certs\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-conf-dir\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-systemd-units\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.751694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751081    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-run-openvswitch\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-run-multus-certs\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-sysctl-conf\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751118    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-systemd-units\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-log-socket\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751148    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-hostroot\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-var-lib-kubelet\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/264493e6-1304-4d77-83e8-dc20b5a46aa2-hosts-file\") pod \"node-resolver-8bjzh\" (UID: \"264493e6-1304-4d77-83e8-dc20b5a46aa2\") " pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xjwb\" (UniqueName: \"kubernetes.io/projected/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-kube-api-access-9xjwb\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/264493e6-1304-4d77-83e8-dc20b5a46aa2-hosts-file\") pod \"node-resolver-8bjzh\" (UID: \"264493e6-1304-4d77-83e8-dc20b5a46aa2\") " pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a-konnectivity-ca\") pod \"konnectivity-agent-gj8cl\" (UID: \"d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a\") " pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-sys\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-tuned\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264493e6-1304-4d77-83e8-dc20b5a46aa2-tmp-dir\") pod \"node-resolver-8bjzh\" (UID: \"264493e6-1304-4d77-83e8-dc20b5a46aa2\") " pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751416    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-etc-openvswitch\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ac8ce73-91e1-4c61-9901-8f1be334b08a-host\") pod \"node-ca-chlpb\" (UID: \"6ac8ce73-91e1-4c61-9901-8f1be334b08a\") " pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751450    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-sys\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.752604 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-lib-modules\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-cni-binary-copy\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-cni-dir\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-var-lib-cni-bin\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-etc-kubernetes\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-run-systemd\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1342119b-f24e-42e5-8dbb-d456eb1b1277-ovn-node-metrics-cert\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmhz9\" (UniqueName: \"kubernetes.io/projected/6ac8ce73-91e1-4c61-9901-8f1be334b08a-kube-api-access-tmhz9\") pod \"node-ca-chlpb\" (UID: \"6ac8ce73-91e1-4c61-9901-8f1be334b08a\") " pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751631    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1342119b-f24e-42e5-8dbb-d456eb1b1277-ovnkube-script-lib\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stkfb\" (UniqueName: \"kubernetes.io/projected/264493e6-1304-4d77-83e8-dc20b5a46aa2-kube-api-access-stkfb\") pod \"node-resolver-8bjzh\" (UID: \"264493e6-1304-4d77-83e8-dc20b5a46aa2\") " pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxxhz\" (UniqueName: \"kubernetes.io/projected/1342119b-f24e-42e5-8dbb-d456eb1b1277-kube-api-access-xxxhz\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/264493e6-1304-4d77-83e8-dc20b5a46aa2-tmp-dir\") pod \"node-resolver-8bjzh\" (UID: \"264493e6-1304-4d77-83e8-dc20b5a46aa2\") " pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-cni-netd\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751750    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-etc-openvswitch\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ac8ce73-91e1-4c61-9901-8f1be334b08a-serviceca\") pod \"node-ca-chlpb\" (UID: \"6ac8ce73-91e1-4c61-9901-8f1be334b08a\") " pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-cni-netd\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1342119b-f24e-42e5-8dbb-d456eb1b1277-env-overrides\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-sysconfig\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.753405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751841    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-host-var-lib-cni-bin\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-modprobe-d\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a-konnectivity-ca\") pod \"konnectivity-agent-gj8cl\" (UID: \"d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a\") " pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-kubelet\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-slash\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.751974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-os-release\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-cni-dir\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-kubelet\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752046    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-slash\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-os-release\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752130    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-modprobe-d\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752142    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6ac8ce73-91e1-4c61-9901-8f1be334b08a-host\") pod \"node-ca-chlpb\" (UID: \"6ac8ce73-91e1-4c61-9901-8f1be334b08a\") " pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-run-ovn\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-run-ovn\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-cni-bin\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752222    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252a0135-3aa3-46d1-94fe-5ea146ff6095-tmp\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752224    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-etc-kubernetes\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752003    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-sysconfig\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.754830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-run-systemd\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.755649 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/252a0135-3aa3-46d1-94fe-5ea146ff6095-lib-modules\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.755649 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1342119b-f24e-42e5-8dbb-d456eb1b1277-env-overrides\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.755649 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752281    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1342119b-f24e-42e5-8dbb-d456eb1b1277-host-cni-bin\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.755649 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-cnibin\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.755649 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-daemon-config\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.755649 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752359    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-cnibin\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.755649 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.752385    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6ac8ce73-91e1-4c61-9901-8f1be334b08a-serviceca\") pod \"node-ca-chlpb\" (UID: \"6ac8ce73-91e1-4c61-9901-8f1be334b08a\") " pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.755649 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.753323    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-multus-daemon-config\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.756412 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.756387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/252a0135-3aa3-46d1-94fe-5ea146ff6095-etc-tuned\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.756653 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.756629    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1342119b-f24e-42e5-8dbb-d456eb1b1277-ovn-node-metrics-cert\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.757039 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.757018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a-agent-certs\") pod \"konnectivity-agent-gj8cl\" (UID: \"d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a\") " pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:38:57.758234 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.758214    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:38:57.758339 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.758242    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:38:57.758339 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.758256    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58qv7 for pod openshift-network-diagnostics/network-check-target-2sblr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:38:57.758339 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:57.758317    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7 podName:1c733e9c-3cc5-4a84-bfb2-9b906456909f nodeName:}" failed. No retries permitted until 2026-07-16 21:38:58.258300452 +0000 UTC m=+3.083945733 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-58qv7" (UniqueName: "kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7") pod "network-check-target-2sblr" (UID: "1c733e9c-3cc5-4a84-bfb2-9b906456909f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:38:57.759399 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.759377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/252a0135-3aa3-46d1-94fe-5ea146ff6095-tmp\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.761661 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.761639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmhz9\" (UniqueName: \"kubernetes.io/projected/6ac8ce73-91e1-4c61-9901-8f1be334b08a-kube-api-access-tmhz9\") pod \"node-ca-chlpb\" (UID: \"6ac8ce73-91e1-4c61-9901-8f1be334b08a\") " pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.762275 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.762253    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xjwb\" (UniqueName: \"kubernetes.io/projected/d5e59492-d40b-429d-ac5a-c4ffbdcf1e88-kube-api-access-9xjwb\") pod \"multus-bdktj\" (UID: \"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88\") " pod="openshift-multus/multus-bdktj"
Jul 16 21:38:57.769425 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.769155    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stkfb\" (UniqueName: \"kubernetes.io/projected/264493e6-1304-4d77-83e8-dc20b5a46aa2-kube-api-access-stkfb\") pod \"node-resolver-8bjzh\" (UID: \"264493e6-1304-4d77-83e8-dc20b5a46aa2\") " pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.769425 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.769384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh7sl\" (UniqueName: \"kubernetes.io/projected/252a0135-3aa3-46d1-94fe-5ea146ff6095-kube-api-access-nh7sl\") pod \"tuned-m2cm2\" (UID: \"252a0135-3aa3-46d1-94fe-5ea146ff6095\") " pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.770791 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.770771    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxxhz\" (UniqueName: \"kubernetes.io/projected/1342119b-f24e-42e5-8dbb-d456eb1b1277-kube-api-access-xxxhz\") pod \"ovnkube-node-vnf82\" (UID: \"1342119b-f24e-42e5-8dbb-d456eb1b1277\") " pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.845694 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.845614    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-84hf2"
Jul 16 21:38:57.854522 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.854496    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv"
Jul 16 21:38:57.865069 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.865043    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gp999"
Jul 16 21:38:57.871822 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.871800    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:38:57.878657 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.878635    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:38:57.887538 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.887522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m2cm2"
Jul 16 21:38:57.894140 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.894122    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-chlpb"
Jul 16 21:38:57.901665 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.901648    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8bjzh"
Jul 16 21:38:57.909385 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:57.909365    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bdktj"
Jul 16 21:38:58.154623 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:58.154531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:58.154780 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:58.154636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:38:58.154780 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:58.154702    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:38:58.154780 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:58.154748    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:38:58.154780 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:58.154782    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret podName:21308f42-77e5-4c41-bc85-caa29a85bafa nodeName:}" failed. No retries permitted until 2026-07-16 21:38:59.154761904 +0000 UTC m=+3.980407183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret") pod "global-pull-secret-syncer-whqdq" (UID: "21308f42-77e5-4c41-bc85-caa29a85bafa") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:38:58.155039 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:58.154805    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs podName:a9e42f68-4446-40f4-9c44-9e7c96acb2e7 nodeName:}" failed. No retries permitted until 2026-07-16 21:38:59.15478924 +0000 UTC m=+3.980434524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs") pod "network-metrics-daemon-h5dfc" (UID: "a9e42f68-4446-40f4-9c44-9e7c96acb2e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:38:58.357005 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:58.356969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qv7\" (UniqueName: \"kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7\") pod \"network-check-target-2sblr\" (UID: \"1c733e9c-3cc5-4a84-bfb2-9b906456909f\") " pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:38:58.357176 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:58.357122    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:38:58.357176 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:58.357147    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:38:58.357176 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:58.357159    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58qv7 for pod openshift-network-diagnostics/network-check-target-2sblr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:38:58.357312 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:58.357223    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7 podName:1c733e9c-3cc5-4a84-bfb2-9b906456909f nodeName:}" failed. No retries permitted until 2026-07-16 21:38:59.357205006 +0000 UTC m=+4.182850293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-58qv7" (UniqueName: "kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7") pod "network-check-target-2sblr" (UID: "1c733e9c-3cc5-4a84-bfb2-9b906456909f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:38:58.580525 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:58.580473    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:33:57 +0000 UTC" deadline="2027-12-24 17:36:10.448606446 +0000 UTC"
Jul 16 21:38:58.580525 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:58.580513    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12619h57m11.868097992s"
Jul 16 21:38:58.666952 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:58.666914    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:38:58.667124 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:58.667033    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:38:58.710403 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:58.710373    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ac8ce73_91e1_4c61_9901_8f1be334b08a.slice/crio-21aa9f1f4c69589c0bbb8a543882437cc3d7afacad6850b566ffea9ca6795e16 WatchSource:0}: Error finding container 21aa9f1f4c69589c0bbb8a543882437cc3d7afacad6850b566ffea9ca6795e16: Status 404 returned error can't find the container with id 21aa9f1f4c69589c0bbb8a543882437cc3d7afacad6850b566ffea9ca6795e16
Jul 16 21:38:58.728458 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:58.728283    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e59492_d40b_429d_ac5a_c4ffbdcf1e88.slice/crio-ca275513209c96bad4cadd1fd0cca3e7a73bd758fbe7082e1b305b0dabec72ec WatchSource:0}: Error finding container ca275513209c96bad4cadd1fd0cca3e7a73bd758fbe7082e1b305b0dabec72ec: Status 404 returned error can't find the container with id ca275513209c96bad4cadd1fd0cca3e7a73bd758fbe7082e1b305b0dabec72ec
Jul 16 21:38:58.729793 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:58.729382    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84166a80_3046_44ef_adb5_46cab1be378f.slice/crio-8e7c2cffce1e4f355a5c8e39389896914ca9fcccb328fdec8b078aa219e739cc WatchSource:0}: Error finding container 8e7c2cffce1e4f355a5c8e39389896914ca9fcccb328fdec8b078aa219e739cc: Status 404 returned error can't find the container with id 8e7c2cffce1e4f355a5c8e39389896914ca9fcccb328fdec8b078aa219e739cc
Jul 16 21:38:58.730109 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:38:58.730015    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1342119b_f24e_42e5_8dbb_d456eb1b1277.slice/crio-652298510cf1c84330901393a7a6da9e0bfd52d78a83afd79055034177a6412b WatchSource:0}: Error finding container 652298510cf1c84330901393a7a6da9e0bfd52d78a83afd79055034177a6412b: Status 404 returned error can't find the container with id 652298510cf1c84330901393a7a6da9e0bfd52d78a83afd79055034177a6412b
Jul 16 21:38:59.163443 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.163326    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:59.163443 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.163432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:38:59.163647 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:59.163556    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:38:59.163647 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:59.163620    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs podName:a9e42f68-4446-40f4-9c44-9e7c96acb2e7 nodeName:}" failed. No retries permitted until 2026-07-16 21:39:01.163601201 +0000 UTC m=+5.989246482 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs") pod "network-metrics-daemon-h5dfc" (UID: "a9e42f68-4446-40f4-9c44-9e7c96acb2e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:38:59.164094 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:59.164019    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:38:59.164094 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:59.164076    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret podName:21308f42-77e5-4c41-bc85-caa29a85bafa nodeName:}" failed. No retries permitted until 2026-07-16 21:39:01.164061774 +0000 UTC m=+5.989707055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret") pod "global-pull-secret-syncer-whqdq" (UID: "21308f42-77e5-4c41-bc85-caa29a85bafa") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:38:59.364405 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.364312    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qv7\" (UniqueName: \"kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7\") pod \"network-check-target-2sblr\" (UID: \"1c733e9c-3cc5-4a84-bfb2-9b906456909f\") " pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:38:59.364584 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:59.364521    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:38:59.364584 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:59.364540    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:38:59.364584 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:59.364553    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58qv7 for pod openshift-network-diagnostics/network-check-target-2sblr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:38:59.364738 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:59.364613    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7 podName:1c733e9c-3cc5-4a84-bfb2-9b906456909f nodeName:}" failed. No retries permitted until 2026-07-16 21:39:01.364594828 +0000 UTC m=+6.190240110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-58qv7" (UniqueName: "kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7") pod "network-check-target-2sblr" (UID: "1c733e9c-3cc5-4a84-bfb2-9b906456909f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:38:59.391191 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.391164    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 21:38:59.581145 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.581085    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 21:33:57 +0000 UTC" deadline="2028-04-16 08:34:48.29330354 +0000 UTC"
Jul 16 21:38:59.581145 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.581144    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15346h55m48.712164549s"
Jul 16 21:38:59.670245 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.669334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:38:59.670245 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:59.669469    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:38:59.670245 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.669836    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:38:59.670245 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:38:59.669922    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:38:59.692451 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.692417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp999" event={"ID":"37897c5f-4e5e-47a1-890c-010bdeb4877a","Type":"ContainerStarted","Data":"55c5ce7683113c01f0304b24b42d41bed7faaa12779771159ed71337fcfdcc84"}
Jul 16 21:38:59.701498 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.701236    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m2cm2" event={"ID":"252a0135-3aa3-46d1-94fe-5ea146ff6095","Type":"ContainerStarted","Data":"c7e9ee61db193dbcdc2cbdeb9baf2413fe15e599677725b2b99561c9c88e847d"}
Jul 16 21:38:59.704707 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.704575    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82" event={"ID":"1342119b-f24e-42e5-8dbb-d456eb1b1277","Type":"ContainerStarted","Data":"652298510cf1c84330901393a7a6da9e0bfd52d78a83afd79055034177a6412b"}
Jul 16 21:38:59.718152 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.718124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bdktj" event={"ID":"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88","Type":"ContainerStarted","Data":"ca275513209c96bad4cadd1fd0cca3e7a73bd758fbe7082e1b305b0dabec72ec"}
Jul 16 21:38:59.726193 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.725578    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" event={"ID":"4e0787be98d7ff323b91c421748cde82","Type":"ContainerStarted","Data":"92e5f56de426a9ac4189f07c979c69fa0f134f0f11ec694d2eb2c8cd1fb09eb4"}
Jul 16 21:38:59.732217 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.732151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84hf2" event={"ID":"0a3fa095-aca5-4943-b6d7-8116aaddae61","Type":"ContainerStarted","Data":"e313bd60c55cd7f84e3c912509f7ba6b1b5270eb1b34b80f6d7a2b978fbe24d0"}
Jul 16 21:38:59.738688 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.738625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gj8cl" event={"ID":"d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a","Type":"ContainerStarted","Data":"c6a822a27342b77d54b996287adfd276f01ffd273af341517ce81513e6e9a68a"}
Jul 16 21:38:59.746584 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.746551    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8bjzh" event={"ID":"264493e6-1304-4d77-83e8-dc20b5a46aa2","Type":"ContainerStarted","Data":"14c4338e5d07bd6ed3553f58a432872193f8da86f68ca1ca1fd8c5bce50c3678"}
Jul 16 21:38:59.755536 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.755446    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv" event={"ID":"84166a80-3046-44ef-adb5-46cab1be378f","Type":"ContainerStarted","Data":"8e7c2cffce1e4f355a5c8e39389896914ca9fcccb328fdec8b078aa219e739cc"}
Jul 16 21:38:59.765209 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.765181    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-chlpb" event={"ID":"6ac8ce73-91e1-4c61-9901-8f1be334b08a","Type":"ContainerStarted","Data":"21aa9f1f4c69589c0bbb8a543882437cc3d7afacad6850b566ffea9ca6795e16"}
Jul 16 21:38:59.774682 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.774615    2563 generic.go:356] "Generic (PLEG): container finished" podID="bd8eab11ad85f88519612ac852560a8a" containerID="8866cdc645c9220c9ebd9d3d912d716b9e03b9b16c35850286b015e28e1f144d" exitCode=0
Jul 16 21:38:59.774682 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.774648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" event={"ID":"bd8eab11ad85f88519612ac852560a8a","Type":"ContainerDied","Data":"8866cdc645c9220c9ebd9d3d912d716b9e03b9b16c35850286b015e28e1f144d"}
Jul 16 21:38:59.791976 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:38:59.791034    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-10.ec2.internal" podStartSLOduration=2.791016331 podStartE2EDuration="2.791016331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:38:59.7412308 +0000 UTC m=+4.566876101" watchObservedRunningTime="2026-07-16 21:38:59.791016331 +0000 UTC m=+4.616661633"
Jul 16 21:39:00.668255 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:00.667767    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:00.668255 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:00.667882    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:00.791063 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:00.790969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" event={"ID":"bd8eab11ad85f88519612ac852560a8a","Type":"ContainerStarted","Data":"eae28a8574305776296320368d50da00b29d2871a34daaafb935101b21351306"}
Jul 16 21:39:01.183858 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:01.183781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:01.183858 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:01.183842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:01.184110 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:01.184065    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:39:01.184163 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:01.184136    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs podName:a9e42f68-4446-40f4-9c44-9e7c96acb2e7 nodeName:}" failed. No retries permitted until 2026-07-16 21:39:05.184116133 +0000 UTC m=+10.009761420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs") pod "network-metrics-daemon-h5dfc" (UID: "a9e42f68-4446-40f4-9c44-9e7c96acb2e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:39:01.184594 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:01.184575    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:39:01.184705 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:01.184630    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret podName:21308f42-77e5-4c41-bc85-caa29a85bafa nodeName:}" failed. No retries permitted until 2026-07-16 21:39:05.184615901 +0000 UTC m=+10.010261186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret") pod "global-pull-secret-syncer-whqdq" (UID: "21308f42-77e5-4c41-bc85-caa29a85bafa") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:39:01.385775 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:01.385725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qv7\" (UniqueName: \"kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7\") pod \"network-check-target-2sblr\" (UID: \"1c733e9c-3cc5-4a84-bfb2-9b906456909f\") " pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:01.385979 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:01.385887    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:39:01.385979 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:01.385906    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:39:01.385979 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:01.385918    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58qv7 for pod openshift-network-diagnostics/network-check-target-2sblr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:39:01.386214 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:01.385994    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7 podName:1c733e9c-3cc5-4a84-bfb2-9b906456909f nodeName:}" failed. No retries permitted until 2026-07-16 21:39:05.385975674 +0000 UTC m=+10.211620973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-58qv7" (UniqueName: "kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7") pod "network-check-target-2sblr" (UID: "1c733e9c-3cc5-4a84-bfb2-9b906456909f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:39:01.668131 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:01.668053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:01.668305 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:01.668199    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:01.668305 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:01.668243    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:01.668787 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:01.668362    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:02.667561 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:02.667523    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:02.667739 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:02.667640    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:03.670139 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:03.669508    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:03.670139 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:03.669636    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:03.670139 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:03.669708    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:03.670139 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:03.669795    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:04.667434 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:04.667355    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:04.667592 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:04.667453    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:05.218159 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:05.218018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:05.218159 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:05.218086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:05.218159 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:05.218159    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:39:05.218648 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:05.218207    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:39:05.218648 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:05.218237    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs podName:a9e42f68-4446-40f4-9c44-9e7c96acb2e7 nodeName:}" failed. No retries permitted until 2026-07-16 21:39:13.218216571 +0000 UTC m=+18.043861852 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs") pod "network-metrics-daemon-h5dfc" (UID: "a9e42f68-4446-40f4-9c44-9e7c96acb2e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:39:05.218648 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:05.218272    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret podName:21308f42-77e5-4c41-bc85-caa29a85bafa nodeName:}" failed. No retries permitted until 2026-07-16 21:39:13.218245305 +0000 UTC m=+18.043890595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret") pod "global-pull-secret-syncer-whqdq" (UID: "21308f42-77e5-4c41-bc85-caa29a85bafa") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:39:05.419764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:05.419716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qv7\" (UniqueName: \"kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7\") pod \"network-check-target-2sblr\" (UID: \"1c733e9c-3cc5-4a84-bfb2-9b906456909f\") " pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:05.419925 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:05.419895    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:39:05.419925 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:05.419920    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:39:05.420043 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:05.419950    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58qv7 for pod openshift-network-diagnostics/network-check-target-2sblr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:39:05.420043 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:05.420010    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7 podName:1c733e9c-3cc5-4a84-bfb2-9b906456909f nodeName:}" failed. No retries permitted until 2026-07-16 21:39:13.419991654 +0000 UTC m=+18.245636944 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-58qv7" (UniqueName: "kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7") pod "network-check-target-2sblr" (UID: "1c733e9c-3cc5-4a84-bfb2-9b906456909f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:39:05.668134 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:05.668060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:05.669332 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:05.669024    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:05.669332 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:05.669105    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:05.669332 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:05.669226    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:06.667957 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:06.667907    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:06.668420 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:06.668037    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:07.667309 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:07.667276    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:07.667485 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:07.667413    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:07.667611 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:07.667497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:07.667664 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:07.667625    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:08.667492 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:08.667455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:08.667930 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:08.667579    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:09.667612 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:09.667579    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:09.668044 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:09.667579    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:09.668044 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:09.667676    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:09.668044 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:09.667797    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:10.667881 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:10.667845    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:10.668345 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:10.667989    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:11.667312 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:11.667277    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:11.667484 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:11.667429    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:11.667547 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:11.667478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:11.667594 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:11.667575    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:12.667330 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:12.667294    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:12.667790 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:12.667413    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:13.278408 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:13.278365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:13.278633 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:13.278451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:13.278633 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:13.278519    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:39:13.278633 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:13.278563    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:39:13.278633 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:13.278589    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret podName:21308f42-77e5-4c41-bc85-caa29a85bafa nodeName:}" failed. No retries permitted until 2026-07-16 21:39:29.278574527 +0000 UTC m=+34.104219805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret") pod "global-pull-secret-syncer-whqdq" (UID: "21308f42-77e5-4c41-bc85-caa29a85bafa") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:39:13.278768 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:13.278655    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs podName:a9e42f68-4446-40f4-9c44-9e7c96acb2e7 nodeName:}" failed. No retries permitted until 2026-07-16 21:39:29.27864095 +0000 UTC m=+34.104286232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs") pod "network-metrics-daemon-h5dfc" (UID: "a9e42f68-4446-40f4-9c44-9e7c96acb2e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:39:13.480205 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:13.480164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qv7\" (UniqueName: \"kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7\") pod \"network-check-target-2sblr\" (UID: \"1c733e9c-3cc5-4a84-bfb2-9b906456909f\") " pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:13.480383 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:13.480338    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:39:13.480383 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:13.480361    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:39:13.480383 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:13.480373    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58qv7 for pod openshift-network-diagnostics/network-check-target-2sblr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:39:13.480535 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:13.480438    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7 podName:1c733e9c-3cc5-4a84-bfb2-9b906456909f nodeName:}" failed. No retries permitted until 2026-07-16 21:39:29.480419497 +0000 UTC m=+34.306064971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-58qv7" (UniqueName: "kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7") pod "network-check-target-2sblr" (UID: "1c733e9c-3cc5-4a84-bfb2-9b906456909f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:39:13.667076 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:13.666992    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:13.667076 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:13.667031    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:13.667331 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:13.667133    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:13.667331 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:13.667254    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:14.667219 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:14.667186    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:14.667389 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:14.667308    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:15.667914 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:15.667878    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:15.668466 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:15.668004    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:15.668466 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:15.668109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:15.668466 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:15.668225    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:16.667115 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:16.667077    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:16.667296 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:16.667210    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:17.673852 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:17.673328    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:17.673852 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:17.673440    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:17.673852 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:17.673504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:17.673852 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:17.673579    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:17.826662 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:17.826431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gj8cl" event={"ID":"d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a","Type":"ContainerStarted","Data":"da1e1617b64e8837f8ad63f785e3d803c3a5c0c024cb8c5474d0801ed138bc05"}
Jul 16 21:39:17.829164 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:17.828692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp999" event={"ID":"37897c5f-4e5e-47a1-890c-010bdeb4877a","Type":"ContainerStarted","Data":"a5d70bbe5c1c55d76df8c9934c265e5b619ceef469828c950a57e90632ad562b"}
Jul 16 21:39:17.830976 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:17.830906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m2cm2" event={"ID":"252a0135-3aa3-46d1-94fe-5ea146ff6095","Type":"ContainerStarted","Data":"9fefe78b8889b7350c04178090a88f1ea041c611ef5b5d511828de72ed18355d"}
Jul 16 21:39:17.833972 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:17.833844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82" event={"ID":"1342119b-f24e-42e5-8dbb-d456eb1b1277","Type":"ContainerStarted","Data":"4f2f1af8d0af52f6a92b0d63a87a974f97552309882fba33bc34d5be69182a95"}
Jul 16 21:39:17.835651 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:17.835600    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bdktj" event={"ID":"d5e59492-d40b-429d-ac5a-c4ffbdcf1e88","Type":"ContainerStarted","Data":"8e6a8153fb0dab85b27cc800d8b9f8c40bf716576ffcf4330e030e2889eed4ae"}
Jul 16 21:39:17.851099 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:17.850649    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-10.ec2.internal" podStartSLOduration=20.850620734 podStartE2EDuration="20.850620734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:00.806041526 +0000 UTC m=+5.631686830" watchObservedRunningTime="2026-07-16 21:39:17.850620734 +0000 UTC m=+22.676266035"
Jul 16 21:39:17.851218 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:17.851175    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gj8cl" podStartSLOduration=3.956588616 podStartE2EDuration="22.851161929s" totalImagesPullingTime="18.894573313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:17.8498085 +0000 UTC m=+22.675453801" watchObservedRunningTime="2026-07-16 21:39:17.851161929 +0000 UTC m=+22.676807231"
Jul 16 21:39:17.905229 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:17.905039    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m2cm2" podStartSLOduration=4.006521441 podStartE2EDuration="22.90502155s" totalImagesPullingTime="18.898500109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:17.904680993 +0000 UTC m=+22.730326293" watchObservedRunningTime="2026-07-16 21:39:17.90502155 +0000 UTC m=+22.730666862"
Jul 16 21:39:18.667811 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.667648    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:18.668012 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:18.667922    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:18.839344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.839305    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8bjzh" event={"ID":"264493e6-1304-4d77-83e8-dc20b5a46aa2","Type":"ContainerStarted","Data":"136e4f7b0090f27e9ba879568a16d88bac160d6c8380c43fe26784188526ef9d"}
Jul 16 21:39:18.840795 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.840769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv" event={"ID":"84166a80-3046-44ef-adb5-46cab1be378f","Type":"ContainerStarted","Data":"0d18bdf5d012383ef966db5c17d4275c4fd08746dbe65ce50be7c58a23365a4a"}
Jul 16 21:39:18.842059 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.842039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-chlpb" event={"ID":"6ac8ce73-91e1-4c61-9901-8f1be334b08a","Type":"ContainerStarted","Data":"924f66c55a7f443d6de716e937c8da16f0553e22f4781e1476019e79dfc55d84"}
Jul 16 21:39:18.843427 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.843403    2563 generic.go:356] "Generic (PLEG): container finished" podID="37897c5f-4e5e-47a1-890c-010bdeb4877a" containerID="a5d70bbe5c1c55d76df8c9934c265e5b619ceef469828c950a57e90632ad562b" exitCode=0
Jul 16 21:39:18.843517 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.843480    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp999" event={"ID":"37897c5f-4e5e-47a1-890c-010bdeb4877a","Type":"ContainerDied","Data":"a5d70bbe5c1c55d76df8c9934c265e5b619ceef469828c950a57e90632ad562b"}
Jul 16 21:39:18.846630 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.846606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82" event={"ID":"1342119b-f24e-42e5-8dbb-d456eb1b1277","Type":"ContainerStarted","Data":"3dcfee19acb863485f78b69dd1ec6629963ad465ce547c4f02c6c9bb8c4a3df3"}
Jul 16 21:39:18.846721 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.846665    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82" event={"ID":"1342119b-f24e-42e5-8dbb-d456eb1b1277","Type":"ContainerStarted","Data":"fa4c304acc3d5bff46770f5cc75cb4b5a95029dc3b3e0f01c5040190ea6444a5"}
Jul 16 21:39:18.846721 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.846695    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82" event={"ID":"1342119b-f24e-42e5-8dbb-d456eb1b1277","Type":"ContainerStarted","Data":"a25502375705d73537d15b29be58b4a604af5fc752294556bc802b55d7aaca30"}
Jul 16 21:39:18.846795 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.846776    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82" event={"ID":"1342119b-f24e-42e5-8dbb-d456eb1b1277","Type":"ContainerStarted","Data":"ea0350b4c545998c1e6f23a6ff5495a3150e667e360fb465618682e0dba3b569"}
Jul 16 21:39:18.846830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.846815    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82" event={"ID":"1342119b-f24e-42e5-8dbb-d456eb1b1277","Type":"ContainerStarted","Data":"2398fcce094815d78466d1be44ddc12e0fea7003801671d187fec4d31c7766b7"}
Jul 16 21:39:18.854447 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.854412    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8bjzh" podStartSLOduration=4.95296624 podStartE2EDuration="23.854400944s" totalImagesPullingTime="18.901434704s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:18.854146813 +0000 UTC m=+23.679792114" watchObservedRunningTime="2026-07-16 21:39:18.854400944 +0000 UTC m=+23.680046245"
Jul 16 21:39:18.854523 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.854475    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bdktj" podStartSLOduration=4.884892097 podStartE2EDuration="23.854470981s" totalImagesPullingTime="18.969578884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:17.931313984 +0000 UTC m=+22.756959270" watchObservedRunningTime="2026-07-16 21:39:18.854470981 +0000 UTC m=+23.680116280"
Jul 16 21:39:18.890004 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:18.889959    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-chlpb" podStartSLOduration=4.972792486 podStartE2EDuration="23.889924574s" totalImagesPullingTime="18.917132088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:18.889569754 +0000 UTC m=+23.715215054" watchObservedRunningTime="2026-07-16 21:39:18.889924574 +0000 UTC m=+23.715569874"
Jul 16 21:39:19.219007 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:19.218983    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 21:39:19.607134 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:19.606972    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T21:39:19.219000983Z","UUID":"e2a8ee0e-0bc3-415a-a2d9-1811f7f888e2","Handler":null,"Name":"","Endpoint":""}
Jul 16 21:39:19.608597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:19.608573    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 21:39:19.608712 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:19.608617    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 21:39:19.668132 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:19.668048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:19.668132 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:19.668071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:19.668378 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:19.668164    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:19.668601 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:19.668571    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:19.850663 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:19.850627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-84hf2" event={"ID":"0a3fa095-aca5-4943-b6d7-8116aaddae61","Type":"ContainerStarted","Data":"c61790414ddf68dfe55da3dd4be5f8a7a4a592eb7f2795958ee3c34b79c1b54b"}
Jul 16 21:39:19.852507 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:19.852476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv" event={"ID":"84166a80-3046-44ef-adb5-46cab1be378f","Type":"ContainerStarted","Data":"4f8671074887f4627167a1d112ce96b76e98296645be6f7bf584de00886a32d2"}
Jul 16 21:39:20.667747 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:20.667713    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:20.668010 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:20.667810    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:20.857013 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:20.856979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv" event={"ID":"84166a80-3046-44ef-adb5-46cab1be378f","Type":"ContainerStarted","Data":"e517bbcec317df0fb827d616e839090e872b46a325768694fa788af34927440c"}
Jul 16 21:39:20.860025 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:20.860001    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82" event={"ID":"1342119b-f24e-42e5-8dbb-d456eb1b1277","Type":"ContainerStarted","Data":"2f1cc2b490df049a2818cf4e4a460352eb0dcd41b03af49af5ba2dd750f1a4a1"}
Jul 16 21:39:20.880581 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:20.880538    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-84hf2" podStartSLOduration=6.977003799 podStartE2EDuration="25.880525266s" totalImagesPullingTime="18.903521467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:19.871125117 +0000 UTC m=+24.696770414" watchObservedRunningTime="2026-07-16 21:39:20.880525266 +0000 UTC m=+25.706170634"
Jul 16 21:39:21.668009 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:21.667977    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:21.668201 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:21.667977    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:21.668201 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:21.668103    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:21.668308 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:21.668215    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:22.237355 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.237321    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:39:22.238095 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.238068    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:39:22.256114 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.256069    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vfljv" podStartSLOduration=6.191105537 podStartE2EDuration="27.256055328s" totalImagesPullingTime="21.064949791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:20.880321833 +0000 UTC m=+25.705967131" watchObservedRunningTime="2026-07-16 21:39:22.256055328 +0000 UTC m=+27.081700627"
Jul 16 21:39:22.667338 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.667172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:22.667453 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:22.667428    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:22.869705 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.869613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82" event={"ID":"1342119b-f24e-42e5-8dbb-d456eb1b1277","Type":"ContainerStarted","Data":"b4b8da1784eacba325effa9405d0019aedce6aa646cd716fabfecdab49c2b882"}
Jul 16 21:39:22.869872 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.869711    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:39:22.870103 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.870079    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:39:22.870191 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.870169    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:39:22.871025 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.871004    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gj8cl"
Jul 16 21:39:22.887123 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.887098    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:39:22.897852 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:22.897815    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82" podStartSLOduration=8.933073572 podStartE2EDuration="27.897801606s" totalImagesPullingTime="18.964728034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:22.896123631 +0000 UTC m=+27.721768933" watchObservedRunningTime="2026-07-16 21:39:22.897801606 +0000 UTC m=+27.723446932"
Jul 16 21:39:23.667134 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:23.667103    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:23.667983 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:23.667101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:23.667983 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:23.667251    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:23.667983 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:23.667340    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:23.883984 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:23.883932    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:39:23.913546 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:23.913514    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:39:24.667061 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:24.667035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:24.667202 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:24.667178    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:24.807381 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:24.807132    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2sblr"]
Jul 16 21:39:24.807779 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:24.807758    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-whqdq"]
Jul 16 21:39:24.807884 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:24.807874    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:24.808031 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:24.808010    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:24.809179 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:24.809156    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h5dfc"]
Jul 16 21:39:24.809277 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:24.809265    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:24.809408 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:24.809349    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:24.885954 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:24.885918    2563 generic.go:356] "Generic (PLEG): container finished" podID="37897c5f-4e5e-47a1-890c-010bdeb4877a" containerID="f00b35f83612c6f245dc9fe7b24364b67a246b50bb100d0e75b5e77e19c54282" exitCode=0
Jul 16 21:39:24.886047 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:24.886012    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:24.886047 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:24.886015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp999" event={"ID":"37897c5f-4e5e-47a1-890c-010bdeb4877a","Type":"ContainerDied","Data":"f00b35f83612c6f245dc9fe7b24364b67a246b50bb100d0e75b5e77e19c54282"}
Jul 16 21:39:24.886374 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:24.886350    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:26.667537 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:26.667508    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:26.668008 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:26.667517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:26.668008 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:26.667647    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:26.668008 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:26.667691    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:26.668008 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:26.667794    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:26.668008 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:26.667864    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:26.891482 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:26.891396    2563 generic.go:356] "Generic (PLEG): container finished" podID="37897c5f-4e5e-47a1-890c-010bdeb4877a" containerID="57ecf7db077752d3628ff864d99cb816f57e3eea2728f1584ecd22a4558a997a" exitCode=0
Jul 16 21:39:26.891482 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:26.891446    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp999" event={"ID":"37897c5f-4e5e-47a1-890c-010bdeb4877a","Type":"ContainerDied","Data":"57ecf7db077752d3628ff864d99cb816f57e3eea2728f1584ecd22a4558a997a"}
Jul 16 21:39:27.896085 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:27.895884    2563 generic.go:356] "Generic (PLEG): container finished" podID="37897c5f-4e5e-47a1-890c-010bdeb4877a" containerID="4f620d5eb3d03d70a63d4aa1c891c545193fbcec227276f5babf6e30180dbfa2" exitCode=0
Jul 16 21:39:27.896433 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:27.895968    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp999" event={"ID":"37897c5f-4e5e-47a1-890c-010bdeb4877a","Type":"ContainerDied","Data":"4f620d5eb3d03d70a63d4aa1c891c545193fbcec227276f5babf6e30180dbfa2"}
Jul 16 21:39:28.667708 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:28.667677    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:28.667891 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:28.667792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:28.667891 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:28.667790    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:28.667991 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:28.667894    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:28.667991 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:28.667789    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:28.667991 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:28.667981    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:29.305051 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:29.305017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:29.305051 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:29.305059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:29.305563 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:29.305167    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 21:39:29.305563 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:29.305168    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:39:29.305563 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:29.305223    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret podName:21308f42-77e5-4c41-bc85-caa29a85bafa nodeName:}" failed. No retries permitted until 2026-07-16 21:40:01.305206959 +0000 UTC m=+66.130852243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret") pod "global-pull-secret-syncer-whqdq" (UID: "21308f42-77e5-4c41-bc85-caa29a85bafa") : object "kube-system"/"original-pull-secret" not registered
Jul 16 21:39:29.305563 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:29.305256    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs podName:a9e42f68-4446-40f4-9c44-9e7c96acb2e7 nodeName:}" failed. No retries permitted until 2026-07-16 21:40:01.305236786 +0000 UTC m=+66.130882067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs") pod "network-metrics-daemon-h5dfc" (UID: "a9e42f68-4446-40f4-9c44-9e7c96acb2e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 21:39:29.506709 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:29.506680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qv7\" (UniqueName: \"kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7\") pod \"network-check-target-2sblr\" (UID: \"1c733e9c-3cc5-4a84-bfb2-9b906456909f\") " pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:29.506866 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:29.506827    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 21:39:29.506866 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:29.506845    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 21:39:29.506866 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:29.506854    2563 projected.go:196] Error preparing data for projected volume kube-api-access-58qv7 for pod openshift-network-diagnostics/network-check-target-2sblr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:39:29.507010 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:29.506905    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7 podName:1c733e9c-3cc5-4a84-bfb2-9b906456909f nodeName:}" failed. No retries permitted until 2026-07-16 21:40:01.506888342 +0000 UTC m=+66.332533623 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-58qv7" (UniqueName: "kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7") pod "network-check-target-2sblr" (UID: "1c733e9c-3cc5-4a84-bfb2-9b906456909f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 21:39:30.244303 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:30.244257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:30.333560 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:30.333527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:30.667857 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:30.667788    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:30.667857 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:30.667812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:30.668069 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:30.667891    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h5dfc" podUID="a9e42f68-4446-40f4-9c44-9e7c96acb2e7"
Jul 16 21:39:30.668069 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:30.667930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:30.668069 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:30.668018    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2sblr" podUID="1c733e9c-3cc5-4a84-bfb2-9b906456909f"
Jul 16 21:39:30.668181 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:30.668078    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-whqdq" podUID="21308f42-77e5-4c41-bc85-caa29a85bafa"
Jul 16 21:39:31.498702 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.498676    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-10.ec2.internal" event="NodeReady"
Jul 16 21:39:31.499090 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.498823    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 21:39:31.545711 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.545679    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fc97bfd7-r6tt4"]
Jul 16 21:39:31.547633 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.547610    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-62fs8"]
Jul 16 21:39:31.547811 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.547746    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.549679 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.549660    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fxp5t"]
Jul 16 21:39:31.549800 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.549780    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.550230 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.550215    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 21:39:31.550444 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.550426    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 21:39:31.550698 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.550681    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jcgfg\""
Jul 16 21:39:31.550764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.550706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 21:39:31.551597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.551578    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxp5t"
Jul 16 21:39:31.552545 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.552531    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 21:39:31.552807 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.552794    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2qh2q\""
Jul 16 21:39:31.552876 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.552848    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 21:39:31.554317 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.554264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 21:39:31.554317 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.554296    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 21:39:31.554848 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.554828    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 21:39:31.555445 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.555367    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wdq25\""
Jul 16 21:39:31.557374 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.557356    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 21:39:31.559007 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.558985    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-62fs8"]
Jul 16 21:39:31.564848 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.564829    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fc97bfd7-r6tt4"]
Jul 16 21:39:31.564929 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.564879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxp5t"]
Jul 16 21:39:31.624210 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.624182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-image-registry-private-configuration\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.624362 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.624223    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-trusted-ca\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.624362 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.624256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faf79fe4-a167-4cb6-ab3b-e881415fd95c-ca-trust-extracted\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.624362 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.624285    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b2b4\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-kube-api-access-9b2b4\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.624362 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.624333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-certificates\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.624558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.624386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-bound-sa-token\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.624558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.624483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-installation-pull-secrets\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.624558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.624520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.687293 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.687254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:31.724787 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.724753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-certificates\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.724975 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.724793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-bound-sa-token\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.724975 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.724928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-installation-pull-secrets\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.725081 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.724984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-562br\" (UniqueName: \"kubernetes.io/projected/8a3f228b-9839-4b30-9763-be6bd3b963e2-kube-api-access-562br\") pod \"ingress-canary-fxp5t\" (UID: \"8a3f228b-9839-4b30-9763-be6bd3b963e2\") " pod="openshift-ingress-canary/ingress-canary-fxp5t"
Jul 16 21:39:31.725081 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.725081 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725036    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gnk5\" (UniqueName: \"kubernetes.io/projected/a55ec89b-bbf5-46c8-a148-4cefc15a983a-kube-api-access-9gnk5\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.725213 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-image-registry-private-configuration\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.725213 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-trusted-ca\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.725213 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faf79fe4-a167-4cb6-ab3b-e881415fd95c-ca-trust-extracted\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.725213 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b2b4\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-kube-api-access-9b2b4\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.725213 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:31.725187    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:39:31.725213 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:31.725201    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc97bfd7-r6tt4: secret "image-registry-tls" not found
Jul 16 21:39:31.725213 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a3f228b-9839-4b30-9763-be6bd3b963e2-cert\") pod \"ingress-canary-fxp5t\" (UID: \"8a3f228b-9839-4b30-9763-be6bd3b963e2\") " pod="openshift-ingress-canary/ingress-canary-fxp5t"
Jul 16 21:39:31.725416 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.725416 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:31.725261    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls podName:faf79fe4-a167-4cb6-ab3b-e881415fd95c nodeName:}" failed. No retries permitted until 2026-07-16 21:39:32.225243409 +0000 UTC m=+37.050888704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls") pod "image-registry-7fc97bfd7-r6tt4" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c") : secret "image-registry-tls" not found
Jul 16 21:39:31.725416 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a55ec89b-bbf5-46c8-a148-4cefc15a983a-config-volume\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.725416 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725332    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a55ec89b-bbf5-46c8-a148-4cefc15a983a-tmp-dir\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.725585 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725458    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-certificates\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.725762 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.725738    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faf79fe4-a167-4cb6-ab3b-e881415fd95c-ca-trust-extracted\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.727151 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.727120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-trusted-ca\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.730171 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.730151    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-image-registry-private-configuration\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.730277 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.730152    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-installation-pull-secrets\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.742416 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.742393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-bound-sa-token\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.746709 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.746663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b2b4\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-kube-api-access-9b2b4\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:31.822414 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.822327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:31.826252 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.826218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a55ec89b-bbf5-46c8-a148-4cefc15a983a-config-volume\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.826252 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.826251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a55ec89b-bbf5-46c8-a148-4cefc15a983a-tmp-dir\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.826399 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.826285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-562br\" (UniqueName: \"kubernetes.io/projected/8a3f228b-9839-4b30-9763-be6bd3b963e2-kube-api-access-562br\") pod \"ingress-canary-fxp5t\" (UID: \"8a3f228b-9839-4b30-9763-be6bd3b963e2\") " pod="openshift-ingress-canary/ingress-canary-fxp5t"
Jul 16 21:39:31.826455 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.826415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gnk5\" (UniqueName: \"kubernetes.io/projected/a55ec89b-bbf5-46c8-a148-4cefc15a983a-kube-api-access-9gnk5\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.826514 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.826492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a3f228b-9839-4b30-9763-be6bd3b963e2-cert\") pod \"ingress-canary-fxp5t\" (UID: \"8a3f228b-9839-4b30-9763-be6bd3b963e2\") " pod="openshift-ingress-canary/ingress-canary-fxp5t"
Jul 16 21:39:31.826571 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.826519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.826625 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.826604    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a55ec89b-bbf5-46c8-a148-4cefc15a983a-tmp-dir\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.826677 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:31.826639    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:39:31.826728 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:31.826701    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls podName:a55ec89b-bbf5-46c8-a148-4cefc15a983a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:32.326683814 +0000 UTC m=+37.152329135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls") pod "dns-default-62fs8" (UID: "a55ec89b-bbf5-46c8-a148-4cefc15a983a") : secret "dns-default-metrics-tls" not found
Jul 16 21:39:31.826875 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.826859    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a55ec89b-bbf5-46c8-a148-4cefc15a983a-config-volume\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.829389 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.829366    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a3f228b-9839-4b30-9763-be6bd3b963e2-cert\") pod \"ingress-canary-fxp5t\" (UID: \"8a3f228b-9839-4b30-9763-be6bd3b963e2\") " pod="openshift-ingress-canary/ingress-canary-fxp5t"
Jul 16 21:39:31.853534 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.853506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-562br\" (UniqueName: \"kubernetes.io/projected/8a3f228b-9839-4b30-9763-be6bd3b963e2-kube-api-access-562br\") pod \"ingress-canary-fxp5t\" (UID: \"8a3f228b-9839-4b30-9763-be6bd3b963e2\") " pod="openshift-ingress-canary/ingress-canary-fxp5t"
Jul 16 21:39:31.854174 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.854150    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gnk5\" (UniqueName: \"kubernetes.io/projected/a55ec89b-bbf5-46c8-a148-4cefc15a983a-kube-api-access-9gnk5\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:31.873261 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:31.873230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fxp5t"
Jul 16 21:39:32.230949 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.230912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:32.231142 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:32.231088    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:39:32.231142 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:32.231108    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc97bfd7-r6tt4: secret "image-registry-tls" not found
Jul 16 21:39:32.231257 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:32.231167    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls podName:faf79fe4-a167-4cb6-ab3b-e881415fd95c nodeName:}" failed. No retries permitted until 2026-07-16 21:39:33.231148403 +0000 UTC m=+38.056793705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls") pod "image-registry-7fc97bfd7-r6tt4" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c") : secret "image-registry-tls" not found
Jul 16 21:39:32.332319 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.332284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:32.332467 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:32.332446    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:39:32.332562 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:32.332540    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls podName:a55ec89b-bbf5-46c8-a148-4cefc15a983a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:33.332515978 +0000 UTC m=+38.158161279 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls") pod "dns-default-62fs8" (UID: "a55ec89b-bbf5-46c8-a148-4cefc15a983a") : secret "dns-default-metrics-tls" not found
Jul 16 21:39:32.440620 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.440583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:32.541793 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.541700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:32.667482 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.667419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:39:32.667482 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.667461    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:39:32.667482 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.667464    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:39:32.670949 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.670916    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 21:39:32.671205 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.671186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 21:39:32.671298 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.671186    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bjvwm\""
Jul 16 21:39:32.671298 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.671185    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cd5nk\""
Jul 16 21:39:32.671298 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.671185    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 21:39:32.671298 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:32.671190    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 21:39:33.224969 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:33.224792    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fxp5t"]
Jul 16 21:39:33.228654 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:39:33.228620    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3f228b_9839_4b30_9763_be6bd3b963e2.slice/crio-1643a18455f9ea75931bfa61648da51c7693a58c8d636ed2c719f30753c75048 WatchSource:0}: Error finding container 1643a18455f9ea75931bfa61648da51c7693a58c8d636ed2c719f30753c75048: Status 404 returned error can't find the container with id 1643a18455f9ea75931bfa61648da51c7693a58c8d636ed2c719f30753c75048
Jul 16 21:39:33.239403 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:33.239380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:33.239549 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:33.239522    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:39:33.239549 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:33.239543    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc97bfd7-r6tt4: secret "image-registry-tls" not found
Jul 16 21:39:33.239674 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:33.239595    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls podName:faf79fe4-a167-4cb6-ab3b-e881415fd95c nodeName:}" failed. No retries permitted until 2026-07-16 21:39:35.239575861 +0000 UTC m=+40.065221147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls") pod "image-registry-7fc97bfd7-r6tt4" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c") : secret "image-registry-tls" not found
Jul 16 21:39:33.339983 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:33.339958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:33.340095 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:33.340081    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:39:33.340139 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:33.340133    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls podName:a55ec89b-bbf5-46c8-a148-4cefc15a983a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:35.340120943 +0000 UTC m=+40.165766224 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls") pod "dns-default-62fs8" (UID: "a55ec89b-bbf5-46c8-a148-4cefc15a983a") : secret "dns-default-metrics-tls" not found
Jul 16 21:39:33.911681 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:33.911645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxp5t" event={"ID":"8a3f228b-9839-4b30-9763-be6bd3b963e2","Type":"ContainerStarted","Data":"1643a18455f9ea75931bfa61648da51c7693a58c8d636ed2c719f30753c75048"}
Jul 16 21:39:33.914790 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:33.914763    2563 generic.go:356] "Generic (PLEG): container finished" podID="37897c5f-4e5e-47a1-890c-010bdeb4877a" containerID="802dfbbeea931c7195ebac59d236dd7b689efcc995c7937c78a290559d44fbb6" exitCode=0
Jul 16 21:39:33.914899 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:33.914823    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp999" event={"ID":"37897c5f-4e5e-47a1-890c-010bdeb4877a","Type":"ContainerDied","Data":"802dfbbeea931c7195ebac59d236dd7b689efcc995c7937c78a290559d44fbb6"}
Jul 16 21:39:34.759486 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:34.759451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:34.809854 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:34.809819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:34.921399 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:34.921363    2563 generic.go:356] "Generic (PLEG): container finished" podID="37897c5f-4e5e-47a1-890c-010bdeb4877a" containerID="693ba774c68f0d725d4531b0dfa7d481af790b0d45b2925bd25ec2d248b66a12" exitCode=0
Jul 16 21:39:34.921850 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:34.921433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp999" event={"ID":"37897c5f-4e5e-47a1-890c-010bdeb4877a","Type":"ContainerDied","Data":"693ba774c68f0d725d4531b0dfa7d481af790b0d45b2925bd25ec2d248b66a12"}
Jul 16 21:39:35.217164 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:35.217120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:35.255271 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:35.255220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:35.255444 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:35.255372    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:39:35.255444 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:35.255394    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc97bfd7-r6tt4: secret "image-registry-tls" not found
Jul 16 21:39:35.255533 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:35.255455    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls podName:faf79fe4-a167-4cb6-ab3b-e881415fd95c nodeName:}" failed. No retries permitted until 2026-07-16 21:39:39.255436578 +0000 UTC m=+44.081081857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls") pod "image-registry-7fc97bfd7-r6tt4" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c") : secret "image-registry-tls" not found
Jul 16 21:39:35.318370 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:35.318334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:35.355709 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:35.355678    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:35.355872 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:35.355848    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:39:35.355963 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:35.355922    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls podName:a55ec89b-bbf5-46c8-a148-4cefc15a983a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:39.355901044 +0000 UTC m=+44.181546344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls") pod "dns-default-62fs8" (UID: "a55ec89b-bbf5-46c8-a148-4cefc15a983a") : secret "dns-default-metrics-tls" not found
Jul 16 21:39:35.741901 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:35.741855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log" limit=1024
Jul 16 21:39:35.925426 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:35.925386    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fxp5t" event={"ID":"8a3f228b-9839-4b30-9763-be6bd3b963e2","Type":"ContainerStarted","Data":"f6b70182bd66d6f475a7fc1953d8fa3209e3ba3f0d8ef679656b3949bf71e25e"}
Jul 16 21:39:35.928753 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:35.928726    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gp999" event={"ID":"37897c5f-4e5e-47a1-890c-010bdeb4877a","Type":"ContainerStarted","Data":"f06a62105d2e1233ddaec18136b107af0849460f02d4a69a660129e248cdf4ea"}
Jul 16 21:39:35.943115 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:35.943068    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fxp5t" podStartSLOduration=2.452197018 podStartE2EDuration="4.943053685s" totalImagesPullingTime="2.490856667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:35.942570612 +0000 UTC m=+40.768215916" watchObservedRunningTime="2026-07-16 21:39:35.943053685 +0000 UTC m=+40.768698987"
Jul 16 21:39:35.969647 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:35.969605    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gp999" podStartSLOduration=8.855323841 podStartE2EDuration="40.969590323s" totalImagesPullingTime="32.114266482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:35.968090117 +0000 UTC m=+40.793735417" watchObservedRunningTime="2026-07-16 21:39:35.969590323 +0000 UTC m=+40.795235655"
Jul 16 21:39:39.285320 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:39.285280    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:39.285708 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:39.285387    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:39:39.285708 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:39.285410    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc97bfd7-r6tt4: secret "image-registry-tls" not found
Jul 16 21:39:39.285708 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:39.285473    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls podName:faf79fe4-a167-4cb6-ab3b-e881415fd95c nodeName:}" failed. No retries permitted until 2026-07-16 21:39:47.285457132 +0000 UTC m=+52.111102410 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls") pod "image-registry-7fc97bfd7-r6tt4" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c") : secret "image-registry-tls" not found
Jul 16 21:39:39.386490 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:39.386457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:39.386642 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:39.386617    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:39:39.386690 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:39.386680    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls podName:a55ec89b-bbf5-46c8-a148-4cefc15a983a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:47.386664975 +0000 UTC m=+52.212310258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls") pod "dns-default-62fs8" (UID: "a55ec89b-bbf5-46c8-a148-4cefc15a983a") : secret "dns-default-metrics-tls" not found
Jul 16 21:39:41.752287 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.752251    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9j2bz"]
Jul 16 21:39:41.786900 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.786870    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9j2bz"]
Jul 16 21:39:41.787048 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.787011    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:41.789521 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.789497    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 21:39:41.789521 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.789508    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vpjhj\""
Jul 16 21:39:41.789709 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.789539    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 21:39:41.789709 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.789563    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 21:39:41.789709 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.789601    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 21:39:41.907832 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.907805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rs7m\" (UniqueName: \"kubernetes.io/projected/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-api-access-4rs7m\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:41.907832 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.907834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:41.908019 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.907974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-crio-socket\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:41.908052 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.908016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-data-volume\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:41.908052 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:41.908034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.009173 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:42.009097    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-crio-socket\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.009173 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:42.009141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-data-volume\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.009173 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:42.009158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.009423 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:42.009179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rs7m\" (UniqueName: \"kubernetes.io/projected/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-api-access-4rs7m\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.009423 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:42.009201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.009423 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:42.009289    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:39:42.009423 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:42.009315    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-crio-socket\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.009423 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:42.009373    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls podName:43b83dcc-467a-46cb-b704-8e7fe5f93e2a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:42.509352108 +0000 UTC m=+47.334997399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9j2bz" (UID: "43b83dcc-467a-46cb-b704-8e7fe5f93e2a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:39:42.009423 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:42.009291    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:39:42.009423 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:42.009422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-data-volume\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.009743 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:42.009461    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm podName:43b83dcc-467a-46cb-b704-8e7fe5f93e2a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:42.509444463 +0000 UTC m=+47.335089741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9j2bz" (UID: "43b83dcc-467a-46cb-b704-8e7fe5f93e2a") : configmap "kube-rbac-proxy" not found
Jul 16 21:39:42.018653 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:42.018628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rs7m\" (UniqueName: \"kubernetes.io/projected/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-api-access-4rs7m\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.513655 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:42.513623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.513859 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:42.513677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:42.513859 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:42.513765    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:39:42.513859 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:42.513804    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:39:42.513859 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:42.513844    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls podName:43b83dcc-467a-46cb-b704-8e7fe5f93e2a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:43.513825717 +0000 UTC m=+48.339471000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9j2bz" (UID: "43b83dcc-467a-46cb-b704-8e7fe5f93e2a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:39:42.514030 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:42.513864    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm podName:43b83dcc-467a-46cb-b704-8e7fe5f93e2a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:43.51385098 +0000 UTC m=+48.339496259 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9j2bz" (UID: "43b83dcc-467a-46cb-b704-8e7fe5f93e2a") : configmap "kube-rbac-proxy" not found
Jul 16 21:39:43.179650 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.179618    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n"]
Jul 16 21:39:43.202608 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.202587    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n"]
Jul 16 21:39:43.202739 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.202680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n"
Jul 16 21:39:43.205320 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.205298    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 16 21:39:43.205960 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.205932    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 16 21:39:43.206019 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.206011    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8lrg8\""
Jul 16 21:39:43.320393 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.320364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrqsw\" (UniqueName: \"kubernetes.io/projected/caddea97-5475-45a6-a7b0-4054679512e1-kube-api-access-wrqsw\") pod \"migrator-7cc9c7ffd7-r749n\" (UID: \"caddea97-5475-45a6-a7b0-4054679512e1\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n"
Jul 16 21:39:43.421722 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.421692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrqsw\" (UniqueName: \"kubernetes.io/projected/caddea97-5475-45a6-a7b0-4054679512e1-kube-api-access-wrqsw\") pod \"migrator-7cc9c7ffd7-r749n\" (UID: \"caddea97-5475-45a6-a7b0-4054679512e1\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n"
Jul 16 21:39:43.430503 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.430436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrqsw\" (UniqueName: \"kubernetes.io/projected/caddea97-5475-45a6-a7b0-4054679512e1-kube-api-access-wrqsw\") pod \"migrator-7cc9c7ffd7-r749n\" (UID: \"caddea97-5475-45a6-a7b0-4054679512e1\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n"
Jul 16 21:39:43.436184 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.436163    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8bjzh_264493e6-1304-4d77-83e8-dc20b5a46aa2/dns-node-resolver/0.log"
Jul 16 21:39:43.511920 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.511893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n"
Jul 16 21:39:43.522251 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.522227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:43.522325 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.522262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:43.522367 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:43.522325    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:39:43.522399 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:43.522373    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm podName:43b83dcc-467a-46cb-b704-8e7fe5f93e2a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:45.52236017 +0000 UTC m=+50.348005452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9j2bz" (UID: "43b83dcc-467a-46cb-b704-8e7fe5f93e2a") : configmap "kube-rbac-proxy" not found
Jul 16 21:39:43.522399 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:43.522371    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:39:43.522466 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:43.522420    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls podName:43b83dcc-467a-46cb-b704-8e7fe5f93e2a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:45.522405328 +0000 UTC m=+50.348050609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9j2bz" (UID: "43b83dcc-467a-46cb-b704-8e7fe5f93e2a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:39:43.653820 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.653789    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n"]
Jul 16 21:39:43.656779 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:39:43.656748    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaddea97_5475_45a6_a7b0_4054679512e1.slice/crio-8b57d329c5bce0fc5087294b2024c3b62aa19f661b09442e870323a47bce964c WatchSource:0}: Error finding container 8b57d329c5bce0fc5087294b2024c3b62aa19f661b09442e870323a47bce964c: Status 404 returned error can't find the container with id 8b57d329c5bce0fc5087294b2024c3b62aa19f661b09442e870323a47bce964c
Jul 16 21:39:43.947049 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:43.947012    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n" event={"ID":"caddea97-5475-45a6-a7b0-4054679512e1","Type":"ContainerStarted","Data":"8b57d329c5bce0fc5087294b2024c3b62aa19f661b09442e870323a47bce964c"}
Jul 16 21:39:44.204023 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.203921    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-q8c4w"]
Jul 16 21:39:44.213073 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.213053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.215546 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.215523    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 16 21:39:44.216355 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.216336    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 16 21:39:44.216460 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.216336    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-n8jqf\""
Jul 16 21:39:44.216460 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.216384    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 16 21:39:44.216460 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.216447    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 16 21:39:44.217588 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.217564    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-q8c4w"]
Jul 16 21:39:44.228089 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.228070    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/40d7ffd2-4931-493f-a041-a76c2f62daca-signing-key\") pod \"service-ca-58598695f7-q8c4w\" (UID: \"40d7ffd2-4931-493f-a041-a76c2f62daca\") " pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.228340 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.228322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/40d7ffd2-4931-493f-a041-a76c2f62daca-signing-cabundle\") pod \"service-ca-58598695f7-q8c4w\" (UID: \"40d7ffd2-4931-493f-a041-a76c2f62daca\") " pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.228438 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.228364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht7k2\" (UniqueName: \"kubernetes.io/projected/40d7ffd2-4931-493f-a041-a76c2f62daca-kube-api-access-ht7k2\") pod \"service-ca-58598695f7-q8c4w\" (UID: \"40d7ffd2-4931-493f-a041-a76c2f62daca\") " pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.235255 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.235229    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-chlpb_6ac8ce73-91e1-4c61-9901-8f1be334b08a/node-ca/0.log"
Jul 16 21:39:44.328718 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.328683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/40d7ffd2-4931-493f-a041-a76c2f62daca-signing-cabundle\") pod \"service-ca-58598695f7-q8c4w\" (UID: \"40d7ffd2-4931-493f-a041-a76c2f62daca\") " pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.328886 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.328741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht7k2\" (UniqueName: \"kubernetes.io/projected/40d7ffd2-4931-493f-a041-a76c2f62daca-kube-api-access-ht7k2\") pod \"service-ca-58598695f7-q8c4w\" (UID: \"40d7ffd2-4931-493f-a041-a76c2f62daca\") " pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.328886 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.328819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/40d7ffd2-4931-493f-a041-a76c2f62daca-signing-key\") pod \"service-ca-58598695f7-q8c4w\" (UID: \"40d7ffd2-4931-493f-a041-a76c2f62daca\") " pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.340419 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.340384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/40d7ffd2-4931-493f-a041-a76c2f62daca-signing-key\") pod \"service-ca-58598695f7-q8c4w\" (UID: \"40d7ffd2-4931-493f-a041-a76c2f62daca\") " pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.340538 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.340493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/40d7ffd2-4931-493f-a041-a76c2f62daca-signing-cabundle\") pod \"service-ca-58598695f7-q8c4w\" (UID: \"40d7ffd2-4931-493f-a041-a76c2f62daca\") " pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.342349 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.342331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht7k2\" (UniqueName: \"kubernetes.io/projected/40d7ffd2-4931-493f-a041-a76c2f62daca-kube-api-access-ht7k2\") pod \"service-ca-58598695f7-q8c4w\" (UID: \"40d7ffd2-4931-493f-a041-a76c2f62daca\") " pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.523282 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.523213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-q8c4w"
Jul 16 21:39:44.674238 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.674164    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-q8c4w"]
Jul 16 21:39:44.678167 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:39:44.678140    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d7ffd2_4931_493f_a041_a76c2f62daca.slice/crio-ed951620391a682e4572a709b123afc7afe8e940a2263c42a3c21221b41f3c8b WatchSource:0}: Error finding container ed951620391a682e4572a709b123afc7afe8e940a2263c42a3c21221b41f3c8b: Status 404 returned error can't find the container with id ed951620391a682e4572a709b123afc7afe8e940a2263c42a3c21221b41f3c8b
Jul 16 21:39:44.951232 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:44.951198    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-q8c4w" event={"ID":"40d7ffd2-4931-493f-a041-a76c2f62daca","Type":"ContainerStarted","Data":"ed951620391a682e4572a709b123afc7afe8e940a2263c42a3c21221b41f3c8b"}
Jul 16 21:39:45.035555 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:45.035522    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fxp5t_8a3f228b-9839-4b30-9763-be6bd3b963e2/serve-healthcheck-canary/0.log"
Jul 16 21:39:45.539363 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:45.539328    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:45.539720 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:45.539371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:45.539720 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:45.539445    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 21:39:45.539720 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:45.539474    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:39:45.539720 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:45.539504    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm podName:43b83dcc-467a-46cb-b704-8e7fe5f93e2a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:49.539478088 +0000 UTC m=+54.365123366 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9j2bz" (UID: "43b83dcc-467a-46cb-b704-8e7fe5f93e2a") : configmap "kube-rbac-proxy" not found
Jul 16 21:39:45.539720 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:45.539539    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls podName:43b83dcc-467a-46cb-b704-8e7fe5f93e2a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:49.539525165 +0000 UTC m=+54.365170447 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9j2bz" (UID: "43b83dcc-467a-46cb-b704-8e7fe5f93e2a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:39:45.955668 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:45.955625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n" event={"ID":"caddea97-5475-45a6-a7b0-4054679512e1","Type":"ContainerStarted","Data":"30db6735474c40416a6a35edebe91fb803056412a12377eb01fcbf8aace6d212"}
Jul 16 21:39:45.955849 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:45.955686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n" event={"ID":"caddea97-5475-45a6-a7b0-4054679512e1","Type":"ContainerStarted","Data":"fb71e82972e745ddc9b669e7e929dd8bd6b5a22d6b2e39c1802f07cae04b7dfe"}
Jul 16 21:39:45.973835 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:45.973788    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-r749n" podStartSLOduration=1.084627119 podStartE2EDuration="2.973773876s" totalImagesPullingTime="1.889146757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:45.972538208 +0000 UTC m=+50.798183510" watchObservedRunningTime="2026-07-16 21:39:45.973773876 +0000 UTC m=+50.799419175"
Jul 16 21:39:47.355857 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:47.355818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:39:47.356251 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:47.355951    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 21:39:47.356251 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:47.355964    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fc97bfd7-r6tt4: secret "image-registry-tls" not found
Jul 16 21:39:47.356251 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:47.356030    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls podName:faf79fe4-a167-4cb6-ab3b-e881415fd95c nodeName:}" failed. No retries permitted until 2026-07-16 21:40:03.356001311 +0000 UTC m=+68.181646590 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls") pod "image-registry-7fc97bfd7-r6tt4" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c") : secret "image-registry-tls" not found
Jul 16 21:39:47.456611 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:47.456585    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:39:47.456765 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:47.456746    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 21:39:47.456836 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:47.456818    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls podName:a55ec89b-bbf5-46c8-a148-4cefc15a983a nodeName:}" failed. No retries permitted until 2026-07-16 21:40:03.456797024 +0000 UTC m=+68.282442311 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls") pod "dns-default-62fs8" (UID: "a55ec89b-bbf5-46c8-a148-4cefc15a983a") : secret "dns-default-metrics-tls" not found
Jul 16 21:39:47.962739 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:47.962705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-q8c4w" event={"ID":"40d7ffd2-4931-493f-a041-a76c2f62daca","Type":"ContainerStarted","Data":"84b739bf6c8d4573732e711caa8d3e471e2a294d710c5c828405bed7ba4127a0"}
Jul 16 21:39:47.979285 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:47.979240    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-q8c4w" podStartSLOduration=1.21152245 podStartE2EDuration="3.979225902s" totalImagesPullingTime="2.767703452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:39:47.978551595 +0000 UTC m=+52.804196896" watchObservedRunningTime="2026-07-16 21:39:47.979225902 +0000 UTC m=+52.804871202"
Jul 16 21:39:49.575315 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:49.575281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:49.575315 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:49.575322    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:49.575742 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:49.575455    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 21:39:49.575742 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:39:49.575530    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls podName:43b83dcc-467a-46cb-b704-8e7fe5f93e2a nodeName:}" failed. No retries permitted until 2026-07-16 21:39:57.575511677 +0000 UTC m=+62.401156956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9j2bz" (UID: "43b83dcc-467a-46cb-b704-8e7fe5f93e2a") : secret "insights-runtime-extractor-tls" not found
Jul 16 21:39:49.575929 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:49.575910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:55.900345 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:55.900317    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vnf82"
Jul 16 21:39:57.635219 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:57.635176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:57.637558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:57.637539    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43b83dcc-467a-46cb-b704-8e7fe5f93e2a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9j2bz\" (UID: \"43b83dcc-467a-46cb-b704-8e7fe5f93e2a\") " pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:57.698054 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:57.698030    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vpjhj\""
Jul 16 21:39:57.705909 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:57.705895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9j2bz"
Jul 16 21:39:57.836170 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:57.836108    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9j2bz"]
Jul 16 21:39:57.840258 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:39:57.840231    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b83dcc_467a_46cb_b704_8e7fe5f93e2a.slice/crio-92e352b35df063d7c91e929ebcfde181a1cccc32451345a50f4aa953e193b552 WatchSource:0}: Error finding container 92e352b35df063d7c91e929ebcfde181a1cccc32451345a50f4aa953e193b552: Status 404 returned error can't find the container with id 92e352b35df063d7c91e929ebcfde181a1cccc32451345a50f4aa953e193b552
Jul 16 21:39:57.987869 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:39:57.987831    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9j2bz" event={"ID":"43b83dcc-467a-46cb-b704-8e7fe5f93e2a","Type":"ContainerStarted","Data":"92e352b35df063d7c91e929ebcfde181a1cccc32451345a50f4aa953e193b552"}
Jul 16 21:40:01.365821 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.365784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:40:01.366360 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.365867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:40:01.368333 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.368314    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 21:40:01.368452 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.368355    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 21:40:01.379670 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.379643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21308f42-77e5-4c41-bc85-caa29a85bafa-original-pull-secret\") pod \"global-pull-secret-syncer-whqdq\" (UID: \"21308f42-77e5-4c41-bc85-caa29a85bafa\") " pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:40:01.379769 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.379669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a9e42f68-4446-40f4-9c44-9e7c96acb2e7-metrics-certs\") pod \"network-metrics-daemon-h5dfc\" (UID: \"a9e42f68-4446-40f4-9c44-9e7c96acb2e7\") " pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:40:01.488062 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.488032    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bjvwm\""
Jul 16 21:40:01.492028 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.492002    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-whqdq"
Jul 16 21:40:01.496138 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.496114    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h5dfc"
Jul 16 21:40:01.567093 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.567053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58qv7\" (UniqueName: \"kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7\") pod \"network-check-target-2sblr\" (UID: \"1c733e9c-3cc5-4a84-bfb2-9b906456909f\") " pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:40:01.570013 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.569991    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 21:40:01.580265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.580243    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 21:40:01.591257 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.591220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58qv7\" (UniqueName: \"kubernetes.io/projected/1c733e9c-3cc5-4a84-bfb2-9b906456909f-kube-api-access-58qv7\") pod \"network-check-target-2sblr\" (UID: \"1c733e9c-3cc5-4a84-bfb2-9b906456909f\") " pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:40:01.781417 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.781384    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cd5nk\""
Jul 16 21:40:01.789285 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:01.789259    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:40:02.805884 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:02.805814    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-whqdq"]
Jul 16 21:40:02.811721 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:40:02.811689    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21308f42_77e5_4c41_bc85_caa29a85bafa.slice/crio-79e6c6cc41861ce15ec58bbaad060a7c5c57850527d876dbbb79d1520f0039ba WatchSource:0}: Error finding container 79e6c6cc41861ce15ec58bbaad060a7c5c57850527d876dbbb79d1520f0039ba: Status 404 returned error can't find the container with id 79e6c6cc41861ce15ec58bbaad060a7c5c57850527d876dbbb79d1520f0039ba
Jul 16 21:40:02.830491 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:02.830444    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h5dfc"]
Jul 16 21:40:02.832898 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:40:02.832863    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e42f68_4446_40f4_9c44_9e7c96acb2e7.slice/crio-775db94904c1aa335bdde28184cb0589018b4bfc125ac5cd9c8fb31ea59c71d2 WatchSource:0}: Error finding container 775db94904c1aa335bdde28184cb0589018b4bfc125ac5cd9c8fb31ea59c71d2: Status 404 returned error can't find the container with id 775db94904c1aa335bdde28184cb0589018b4bfc125ac5cd9c8fb31ea59c71d2
Jul 16 21:40:03.003493 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.003449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-whqdq" event={"ID":"21308f42-77e5-4c41-bc85-caa29a85bafa","Type":"ContainerStarted","Data":"79e6c6cc41861ce15ec58bbaad060a7c5c57850527d876dbbb79d1520f0039ba"}
Jul 16 21:40:03.004726 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.004700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5dfc" event={"ID":"a9e42f68-4446-40f4-9c44-9e7c96acb2e7","Type":"ContainerStarted","Data":"775db94904c1aa335bdde28184cb0589018b4bfc125ac5cd9c8fb31ea59c71d2"}
Jul 16 21:40:03.006183 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.006160    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9j2bz" event={"ID":"43b83dcc-467a-46cb-b704-8e7fe5f93e2a","Type":"ContainerStarted","Data":"4fb4aebf4691896e6c4fbbfa329737212a520d374c286628a0630ab2fbecf696"}
Jul 16 21:40:03.033807 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.033782    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2sblr"]
Jul 16 21:40:03.037048 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:40:03.037019    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c733e9c_3cc5_4a84_bfb2_9b906456909f.slice/crio-83758e8fff69eb2ef715e21913b0e38cc10195fe29367e16600d6778a574a9f8 WatchSource:0}: Error finding container 83758e8fff69eb2ef715e21913b0e38cc10195fe29367e16600d6778a574a9f8: Status 404 returned error can't find the container with id 83758e8fff69eb2ef715e21913b0e38cc10195fe29367e16600d6778a574a9f8
Jul 16 21:40:03.381646 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.381575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:40:03.384504 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.384478    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") pod \"image-registry-7fc97bfd7-r6tt4\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") " pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:40:03.482016 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.481978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:40:03.484960 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.484912    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a55ec89b-bbf5-46c8-a148-4cefc15a983a-metrics-tls\") pod \"dns-default-62fs8\" (UID: \"a55ec89b-bbf5-46c8-a148-4cefc15a983a\") " pod="openshift-dns/dns-default-62fs8"
Jul 16 21:40:03.662417 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.662343    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jcgfg\""
Jul 16 21:40:03.670954 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.670731    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2qh2q\""
Jul 16 21:40:03.671316 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.671139    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:40:03.678740 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.678720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-62fs8"
Jul 16 21:40:03.868729 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.868701    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fc97bfd7-r6tt4"]
Jul 16 21:40:03.878580 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:03.878551    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-62fs8"]
Jul 16 21:40:04.011583 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:04.011548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2sblr" event={"ID":"1c733e9c-3cc5-4a84-bfb2-9b906456909f","Type":"ContainerStarted","Data":"83758e8fff69eb2ef715e21913b0e38cc10195fe29367e16600d6778a574a9f8"}
Jul 16 21:40:04.270986 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:40:04.270898    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf79fe4_a167_4cb6_ab3b_e881415fd95c.slice/crio-90abec44b61f9cef0dfbcd4fe05b35161cb1c1ef68fadbe6d95747be2fe8ef14 WatchSource:0}: Error finding container 90abec44b61f9cef0dfbcd4fe05b35161cb1c1ef68fadbe6d95747be2fe8ef14: Status 404 returned error can't find the container with id 90abec44b61f9cef0dfbcd4fe05b35161cb1c1ef68fadbe6d95747be2fe8ef14
Jul 16 21:40:04.271309 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:40:04.271278    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55ec89b_bbf5_46c8_a148_4cefc15a983a.slice/crio-0effe509d621f0546465b27ad2ec0cd1a567d2f1c162b09f1ac75b8f38fb1a5a WatchSource:0}: Error finding container 0effe509d621f0546465b27ad2ec0cd1a567d2f1c162b09f1ac75b8f38fb1a5a: Status 404 returned error can't find the container with id 0effe509d621f0546465b27ad2ec0cd1a567d2f1c162b09f1ac75b8f38fb1a5a
Jul 16 21:40:05.020158 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:05.020094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-62fs8" event={"ID":"a55ec89b-bbf5-46c8-a148-4cefc15a983a","Type":"ContainerStarted","Data":"0effe509d621f0546465b27ad2ec0cd1a567d2f1c162b09f1ac75b8f38fb1a5a"}
Jul 16 21:40:05.023593 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:05.022767    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4" event={"ID":"faf79fe4-a167-4cb6-ab3b-e881415fd95c","Type":"ContainerStarted","Data":"9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5"}
Jul 16 21:40:05.023593 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:05.022809    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4" event={"ID":"faf79fe4-a167-4cb6-ab3b-e881415fd95c","Type":"ContainerStarted","Data":"90abec44b61f9cef0dfbcd4fe05b35161cb1c1ef68fadbe6d95747be2fe8ef14"}
Jul 16 21:40:05.023593 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:05.023538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:40:05.026520 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:05.025862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5dfc" event={"ID":"a9e42f68-4446-40f4-9c44-9e7c96acb2e7","Type":"ContainerStarted","Data":"27b8a198491063e8709a180da3dfe943f6ba237e0c2e290cd597debf71799c54"}
Jul 16 21:40:05.026520 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:05.025904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h5dfc" event={"ID":"a9e42f68-4446-40f4-9c44-9e7c96acb2e7","Type":"ContainerStarted","Data":"868f651f2b88189c34e419597e01aea6d00db6a1dcddb93c6bdb82bcdeb43a4c"}
Jul 16 21:40:05.044982 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:05.044526    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4" podStartSLOduration=44.044509069 podStartE2EDuration="44.044509069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:05.0427844 +0000 UTC m=+69.868429692" watchObservedRunningTime="2026-07-16 21:40:05.044509069 +0000 UTC m=+69.870154371"
Jul 16 21:40:05.058780 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:05.058729    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h5dfc" podStartSLOduration=68.290444479 podStartE2EDuration="1m10.058712972s" totalImagesPullingTime="1.768268493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:05.058128113 +0000 UTC m=+69.883773415" watchObservedRunningTime="2026-07-16 21:40:05.058712972 +0000 UTC m=+69.884358274"
Jul 16 21:40:07.941262 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.941233    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"]
Jul 16 21:40:07.944489 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.944462    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"
Jul 16 21:40:07.945676 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.945651    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"]
Jul 16 21:40:07.948039 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.947655    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:07.949299 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.949116    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 21:40:07.949299 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.949119    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 21:40:07.956984 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.956881    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 21:40:07.957185 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.957169    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6z9bw\""
Jul 16 21:40:07.957465 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.957447    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 21:40:07.957541 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.957534    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 21:40:07.957600 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.957570    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 21:40:07.957600 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.957588    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 21:40:07.957713 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.957689    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 16 21:40:07.965480 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.965461    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"]
Jul 16 21:40:07.979038 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.979006    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"]
Jul 16 21:40:07.980155 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:07.980130    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fc97bfd7-r6tt4"]
Jul 16 21:40:08.019113 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.019086    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-ca\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.019238 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.019150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfxgk\" (UniqueName: \"kubernetes.io/projected/033ca42f-ea72-45b6-8c1d-282e6fe92d60-kube-api-access-jfxgk\") pod \"managed-serviceaccount-addon-agent-6544d455f6-wrznx\" (UID: \"033ca42f-ea72-45b6-8c1d-282e6fe92d60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"
Jul 16 21:40:08.019238 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.019182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkf9p\" (UniqueName: \"kubernetes.io/projected/640eeba9-985c-4d6d-a755-767e3edfd086-kube-api-access-xkf9p\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.019238 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.019201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.019351 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.019291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-hub\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.019351 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.019316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.019351 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.019341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/033ca42f-ea72-45b6-8c1d-282e6fe92d60-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6544d455f6-wrznx\" (UID: \"033ca42f-ea72-45b6-8c1d-282e6fe92d60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"
Jul 16 21:40:08.019468 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.019363    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/640eeba9-985c-4d6d-a755-767e3edfd086-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.120504 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.120467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-hub\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.120673 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.120512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.120673 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.120653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/033ca42f-ea72-45b6-8c1d-282e6fe92d60-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6544d455f6-wrznx\" (UID: \"033ca42f-ea72-45b6-8c1d-282e6fe92d60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"
Jul 16 21:40:08.120787 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.120699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/640eeba9-985c-4d6d-a755-767e3edfd086-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.120787 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.120726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-ca\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.120787 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.120774    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfxgk\" (UniqueName: \"kubernetes.io/projected/033ca42f-ea72-45b6-8c1d-282e6fe92d60-kube-api-access-jfxgk\") pod \"managed-serviceaccount-addon-agent-6544d455f6-wrznx\" (UID: \"033ca42f-ea72-45b6-8c1d-282e6fe92d60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"
Jul 16 21:40:08.120958 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.120805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkf9p\" (UniqueName: \"kubernetes.io/projected/640eeba9-985c-4d6d-a755-767e3edfd086-kube-api-access-xkf9p\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.120958 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.120832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.121621 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.121574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/640eeba9-985c-4d6d-a755-767e3edfd086-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.123672 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.123649    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.123777 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.123739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-hub\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.124153 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.124114    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-ca\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.124281 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.124262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/640eeba9-985c-4d6d-a755-767e3edfd086-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.124368 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.124348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/033ca42f-ea72-45b6-8c1d-282e6fe92d60-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6544d455f6-wrznx\" (UID: \"033ca42f-ea72-45b6-8c1d-282e6fe92d60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"
Jul 16 21:40:08.128814 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.128789    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bd9844569-gxg48"]
Jul 16 21:40:08.131756 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.131737    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.140198 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.140173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfxgk\" (UniqueName: \"kubernetes.io/projected/033ca42f-ea72-45b6-8c1d-282e6fe92d60-kube-api-access-jfxgk\") pod \"managed-serviceaccount-addon-agent-6544d455f6-wrznx\" (UID: \"033ca42f-ea72-45b6-8c1d-282e6fe92d60\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"
Jul 16 21:40:08.140641 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.140623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkf9p\" (UniqueName: \"kubernetes.io/projected/640eeba9-985c-4d6d-a755-767e3edfd086-kube-api-access-xkf9p\") pod \"cluster-proxy-proxy-agent-7477ffcf79-zrlhr\" (UID: \"640eeba9-985c-4d6d-a755-767e3edfd086\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.147411 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.147342    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bd9844569-gxg48"]
Jul 16 21:40:08.222320 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.222235    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9kmp\" (UniqueName: \"kubernetes.io/projected/667d6bfa-9e35-406e-b763-08911de18315-kube-api-access-l9kmp\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.222320 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.222281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/667d6bfa-9e35-406e-b763-08911de18315-installation-pull-secrets\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.222558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.222327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/667d6bfa-9e35-406e-b763-08911de18315-ca-trust-extracted\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.222558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.222356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667d6bfa-9e35-406e-b763-08911de18315-bound-sa-token\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.222558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.222431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667d6bfa-9e35-406e-b763-08911de18315-trusted-ca\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.222558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.222466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667d6bfa-9e35-406e-b763-08911de18315-registry-tls\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.222558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.222500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/667d6bfa-9e35-406e-b763-08911de18315-image-registry-private-configuration\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.222558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.222529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/667d6bfa-9e35-406e-b763-08911de18315-registry-certificates\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.273617 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.273590    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"
Jul 16 21:40:08.280743 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.280720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"
Jul 16 21:40:08.323744 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.323710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/667d6bfa-9e35-406e-b763-08911de18315-installation-pull-secrets\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.323920 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.323762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/667d6bfa-9e35-406e-b763-08911de18315-ca-trust-extracted\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.323920 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.323790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667d6bfa-9e35-406e-b763-08911de18315-bound-sa-token\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.323920 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.323816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667d6bfa-9e35-406e-b763-08911de18315-trusted-ca\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.323920 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.323848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667d6bfa-9e35-406e-b763-08911de18315-registry-tls\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.323920 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.323872    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/667d6bfa-9e35-406e-b763-08911de18315-image-registry-private-configuration\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.323920 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.323889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/667d6bfa-9e35-406e-b763-08911de18315-registry-certificates\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.323920 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.323914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9kmp\" (UniqueName: \"kubernetes.io/projected/667d6bfa-9e35-406e-b763-08911de18315-kube-api-access-l9kmp\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.324383 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.324360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/667d6bfa-9e35-406e-b763-08911de18315-ca-trust-extracted\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.324901 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.324860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/667d6bfa-9e35-406e-b763-08911de18315-registry-certificates\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.325018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.324978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/667d6bfa-9e35-406e-b763-08911de18315-trusted-ca\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.326667 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.326644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/667d6bfa-9e35-406e-b763-08911de18315-installation-pull-secrets\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.327014 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.326997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/667d6bfa-9e35-406e-b763-08911de18315-registry-tls\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.327449 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.327430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/667d6bfa-9e35-406e-b763-08911de18315-image-registry-private-configuration\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.333182 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.333154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/667d6bfa-9e35-406e-b763-08911de18315-bound-sa-token\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.333589 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.333566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9kmp\" (UniqueName: \"kubernetes.io/projected/667d6bfa-9e35-406e-b763-08911de18315-kube-api-access-l9kmp\") pod \"image-registry-7bd9844569-gxg48\" (UID: \"667d6bfa-9e35-406e-b763-08911de18315\") " pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:08.466519 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:08.466484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:10.546391 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:10.544075    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bd9844569-gxg48"]
Jul 16 21:40:10.551557 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:10.551530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr"]
Jul 16 21:40:10.554919 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:40:10.554886    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod640eeba9_985c_4d6d_a755_767e3edfd086.slice/crio-ce4645e2a9c71aebe344b15bc262f2d6ffb01ecb328ec03975ee8e98ee07a285 WatchSource:0}: Error finding container ce4645e2a9c71aebe344b15bc262f2d6ffb01ecb328ec03975ee8e98ee07a285: Status 404 returned error can't find the container with id ce4645e2a9c71aebe344b15bc262f2d6ffb01ecb328ec03975ee8e98ee07a285
Jul 16 21:40:10.573473 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:10.568680    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx"]
Jul 16 21:40:11.053823 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.053784    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-whqdq" event={"ID":"21308f42-77e5-4c41-bc85-caa29a85bafa","Type":"ContainerStarted","Data":"92a5ab0cf3937007039796d65d6d5cb5c89f0ea921a4ca2e4f471ad74be39253"}
Jul 16 21:40:11.055237 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.055211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx" event={"ID":"033ca42f-ea72-45b6-8c1d-282e6fe92d60","Type":"ContainerStarted","Data":"624699de02b48e212a74f4a0cd145e0f30176b5c7ed5c0e39b19d00ab68f24d4"}
Jul 16 21:40:11.056290 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.056262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr" event={"ID":"640eeba9-985c-4d6d-a755-767e3edfd086","Type":"ContainerStarted","Data":"ce4645e2a9c71aebe344b15bc262f2d6ffb01ecb328ec03975ee8e98ee07a285"}
Jul 16 21:40:11.057862 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.057834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9j2bz" event={"ID":"43b83dcc-467a-46cb-b704-8e7fe5f93e2a","Type":"ContainerStarted","Data":"5d8ff6c20fc8c6414d7c09b2346973d8845b0cf2533b0180038fc040443f772e"}
Jul 16 21:40:11.059194 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.059173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2sblr" event={"ID":"1c733e9c-3cc5-4a84-bfb2-9b906456909f","Type":"ContainerStarted","Data":"5f7af7063495cc52e2047e820e3661b44ccfd81173d1173d90ce1871e97dc4dd"}
Jul 16 21:40:11.059301 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.059227    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:40:11.060870 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.060850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-62fs8" event={"ID":"a55ec89b-bbf5-46c8-a148-4cefc15a983a","Type":"ContainerStarted","Data":"cc00bab99ef299cbc3f22577ba09040097322d4dada6de8fbde91a234ce2268b"}
Jul 16 21:40:11.060974 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.060888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-62fs8" event={"ID":"a55ec89b-bbf5-46c8-a148-4cefc15a983a","Type":"ContainerStarted","Data":"95785eb7d9fdf7035e5d81466bdb8e961cba273022f0b5e84d3ca8d7e232db81"}
Jul 16 21:40:11.061033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.060980    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-62fs8"
Jul 16 21:40:11.062241 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.062223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bd9844569-gxg48" event={"ID":"667d6bfa-9e35-406e-b763-08911de18315","Type":"ContainerStarted","Data":"f9e963518bc673c94126d8723e921c473c8ca06a368d471087d9904567ae120a"}
Jul 16 21:40:11.062326 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.062254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bd9844569-gxg48" event={"ID":"667d6bfa-9e35-406e-b763-08911de18315","Type":"ContainerStarted","Data":"c69a326da9bb80ce8e29342328e48790d5b94fcd6b27d1d6e1c51f74f0b20733"}
Jul 16 21:40:11.062326 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.062308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:11.069325 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.069289    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-whqdq" podStartSLOduration=68.530999476 podStartE2EDuration="1m16.069276917s" totalImagesPullingTime="7.538277441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:11.068510833 +0000 UTC m=+75.894156137" watchObservedRunningTime="2026-07-16 21:40:11.069276917 +0000 UTC m=+75.894922195"
Jul 16 21:40:11.086648 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.086609    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-62fs8" podStartSLOduration=34.016788971 podStartE2EDuration="40.086596869s" totalImagesPullingTime="6.069807898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:11.086132715 +0000 UTC m=+75.911778021" watchObservedRunningTime="2026-07-16 21:40:11.086596869 +0000 UTC m=+75.912242146"
Jul 16 21:40:11.108632 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:11.108583    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bd9844569-gxg48" podStartSLOduration=3.108570547 podStartE2EDuration="3.108570547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:11.107199946 +0000 UTC m=+75.932845258" watchObservedRunningTime="2026-07-16 21:40:11.108570547 +0000 UTC m=+75.934215825"
Jul 16 21:40:18.093348 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:18.093313    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx" event={"ID":"033ca42f-ea72-45b6-8c1d-282e6fe92d60","Type":"ContainerStarted","Data":"f35e57fde47bf4a2f352bd3ede88e654e63e49af4757b70c5f313fc721086c6a"}
Jul 16 21:40:18.095274 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:18.095253    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr" event={"ID":"640eeba9-985c-4d6d-a755-767e3edfd086","Type":"ContainerStarted","Data":"8e86fef7b2d594a65eee6b97e68402ab9c7fc01d3b7830eb34a254722c13f252"}
Jul 16 21:40:18.095378 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:18.095288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr" event={"ID":"640eeba9-985c-4d6d-a755-767e3edfd086","Type":"ContainerStarted","Data":"d5062dacca2425c4868f015670b1ec829e9c2141d05735212ad333a795d38969"}
Jul 16 21:40:18.095378 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:18.095302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr" event={"ID":"640eeba9-985c-4d6d-a755-767e3edfd086","Type":"ContainerStarted","Data":"6a22bab20cbd3f1aaa2ff58479ca76c5c2119ad1c894b2f3380cc634f275829a"}
Jul 16 21:40:18.097172 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:18.097142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9j2bz" event={"ID":"43b83dcc-467a-46cb-b704-8e7fe5f93e2a","Type":"ContainerStarted","Data":"e0d00e7bc5149c1da55f0f2a35ee3056f64769102758abc977be05e70e17af30"}
Jul 16 21:40:18.109657 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:18.109617    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6544d455f6-wrznx" podStartSLOduration=4.331483942 podStartE2EDuration="11.109603929s" totalImagesPullingTime="6.778119987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:18.109304817 +0000 UTC m=+82.934950117" watchObservedRunningTime="2026-07-16 21:40:18.109603929 +0000 UTC m=+82.935249228"
Jul 16 21:40:18.109905 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:18.109880    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2sblr" podStartSLOduration=75.804376484 podStartE2EDuration="1m23.10987048s" totalImagesPullingTime="7.305493996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:11.135630631 +0000 UTC m=+75.961275933" watchObservedRunningTime="2026-07-16 21:40:18.10987048 +0000 UTC m=+82.935515779"
Jul 16 21:40:18.128248 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:18.128203    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9j2bz" podStartSLOduration=17.849370399 podStartE2EDuration="37.128190852s" totalImagesPullingTime="19.278820453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 21:39:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:18.127154516 +0000 UTC m=+82.952799816" watchObservedRunningTime="2026-07-16 21:40:18.128190852 +0000 UTC m=+82.953836176"
Jul 16 21:40:18.144329 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:18.144257    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7477ffcf79-zrlhr" podStartSLOduration=4.343436356 podStartE2EDuration="11.14423317s" totalImagesPullingTime="6.800796814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:40:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:18.143998589 +0000 UTC m=+82.969643891" watchObservedRunningTime="2026-07-16 21:40:18.14423317 +0000 UTC m=+82.969878471"
Jul 16 21:40:21.068304 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:21.068274    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-62fs8"
Jul 16 21:40:25.333118 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.333083    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-48czs"]
Jul 16 21:40:25.336602 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.336580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.339181 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.339151    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 21:40:25.339312 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.339233    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 21:40:25.339657 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.339641    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 21:40:25.339772 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.339756    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pm9ql\""
Jul 16 21:40:25.339840 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.339749    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 21:40:25.339896 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.339864    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 21:40:25.340016 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.339991    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 21:40:25.465599 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.465562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.465798 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.465617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0b98089-e1ff-4f51-bb88-95d81377d251-sys\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.465798 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.465645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-accelerators-collector-config\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.465798 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.465690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-wtmp\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.465798 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.465745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-textfile\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.466033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.465832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0b98089-e1ff-4f51-bb88-95d81377d251-metrics-client-ca\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.466033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.465860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9665h\" (UniqueName: \"kubernetes.io/projected/b0b98089-e1ff-4f51-bb88-95d81377d251-kube-api-access-9665h\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.466033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.465927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0b98089-e1ff-4f51-bb88-95d81377d251-root\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.466033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.465981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-tls\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567201 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0b98089-e1ff-4f51-bb88-95d81377d251-metrics-client-ca\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567201 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9665h\" (UniqueName: \"kubernetes.io/projected/b0b98089-e1ff-4f51-bb88-95d81377d251-kube-api-access-9665h\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567449 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0b98089-e1ff-4f51-bb88-95d81377d251-root\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567449 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-tls\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567449 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567275    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567449 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0b98089-e1ff-4f51-bb88-95d81377d251-sys\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567449 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567331    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-accelerators-collector-config\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567449 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-wtmp\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567449 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-textfile\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567804 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567564    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b0b98089-e1ff-4f51-bb88-95d81377d251-root\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.567859 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.567830    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0b98089-e1ff-4f51-bb88-95d81377d251-metrics-client-ca\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.568330 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.568063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-wtmp\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.568330 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.568181    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-textfile\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.568330 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.568172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0b98089-e1ff-4f51-bb88-95d81377d251-sys\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.568573 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.568504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-accelerators-collector-config\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.570094 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.570061    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.570868 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.570849    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b0b98089-e1ff-4f51-bb88-95d81377d251-node-exporter-tls\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.577139 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.577104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9665h\" (UniqueName: \"kubernetes.io/projected/b0b98089-e1ff-4f51-bb88-95d81377d251-kube-api-access-9665h\") pod \"node-exporter-48czs\" (UID: \"b0b98089-e1ff-4f51-bb88-95d81377d251\") " pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.648891 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:25.648808    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-48czs"
Jul 16 21:40:25.660466 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:40:25.660445    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b98089_e1ff_4f51_bb88_95d81377d251.slice/crio-f83f3718b69d13971b245c8c0c30ecfa7d13336ef9b3b200b5796154c65ca996 WatchSource:0}: Error finding container f83f3718b69d13971b245c8c0c30ecfa7d13336ef9b3b200b5796154c65ca996: Status 404 returned error can't find the container with id f83f3718b69d13971b245c8c0c30ecfa7d13336ef9b3b200b5796154c65ca996
Jul 16 21:40:26.123633 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:26.123594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48czs" event={"ID":"b0b98089-e1ff-4f51-bb88-95d81377d251","Type":"ContainerStarted","Data":"f83f3718b69d13971b245c8c0c30ecfa7d13336ef9b3b200b5796154c65ca996"}
Jul 16 21:40:28.044784 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:28.044755    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:40:28.132185 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:28.132149    2563 generic.go:356] "Generic (PLEG): container finished" podID="b0b98089-e1ff-4f51-bb88-95d81377d251" containerID="993b34a9333908212639ecaa207b02c87f3abced3b3a454ea68a6aa3a1d76e68" exitCode=0
Jul 16 21:40:28.132362 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:28.132241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48czs" event={"ID":"b0b98089-e1ff-4f51-bb88-95d81377d251","Type":"ContainerDied","Data":"993b34a9333908212639ecaa207b02c87f3abced3b3a454ea68a6aa3a1d76e68"}
Jul 16 21:40:29.137912 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:29.137875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48czs" event={"ID":"b0b98089-e1ff-4f51-bb88-95d81377d251","Type":"ContainerStarted","Data":"cc9ed2b0d5fc3d2f260b88827f2ad9a5ac2edfda3e12b77f8ced46bbf1c3b0f6"}
Jul 16 21:40:29.138427 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:29.137926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-48czs" event={"ID":"b0b98089-e1ff-4f51-bb88-95d81377d251","Type":"ContainerStarted","Data":"458b35a5546bdd8ef8ac5945277ab799249459cbf1c4d425828be04af3ff10ec"}
Jul 16 21:40:29.163698 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:29.163651    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-48czs" podStartSLOduration=2.381799143 podStartE2EDuration="4.163637112s" totalImagesPullingTime="1.71073999s" totalInitContainerRuntime="71.097979ms" isStatefulPod=true podCreationTimestamp="2026-07-16 21:40:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:40:29.161894373 +0000 UTC m=+93.987539672" watchObservedRunningTime="2026-07-16 21:40:29.163637112 +0000 UTC m=+93.989282412"
Jul 16 21:40:32.070011 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:32.069987    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bd9844569-gxg48"
Jul 16 21:40:33.063106 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.063063    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4" podUID="faf79fe4-a167-4cb6-ab3b-e881415fd95c" containerName="registry" containerID="cri-o://9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5" gracePeriod=30
Jul 16 21:40:33.314082 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.314028    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:40:33.431448 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.431417    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-certificates\") pod \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") "
Jul 16 21:40:33.431448 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.431453    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faf79fe4-a167-4cb6-ab3b-e881415fd95c-ca-trust-extracted\") pod \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") "
Jul 16 21:40:33.431637 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.431475    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-installation-pull-secrets\") pod \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") "
Jul 16 21:40:33.431637 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.431495    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-bound-sa-token\") pod \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") "
Jul 16 21:40:33.431637 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.431618    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b2b4\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-kube-api-access-9b2b4\") pod \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") "
Jul 16 21:40:33.431766 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.431651    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-image-registry-private-configuration\") pod \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") "
Jul 16 21:40:33.431766 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.431712    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-trusted-ca\") pod \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") "
Jul 16 21:40:33.431766 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.431736    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") pod \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\" (UID: \"faf79fe4-a167-4cb6-ab3b-e881415fd95c\") "
Jul 16 21:40:33.431918 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.431859    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "faf79fe4-a167-4cb6-ab3b-e881415fd95c" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:40:33.432006 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.431995    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-certificates\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:40:33.432489 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.432357    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "faf79fe4-a167-4cb6-ab3b-e881415fd95c" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:40:33.434239 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.434209    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "faf79fe4-a167-4cb6-ab3b-e881415fd95c" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:40:33.434362 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.434309    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "faf79fe4-a167-4cb6-ab3b-e881415fd95c" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:40:33.434430 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.434405    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "faf79fe4-a167-4cb6-ab3b-e881415fd95c" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:40:33.434520 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.434498    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-kube-api-access-9b2b4" (OuterVolumeSpecName: "kube-api-access-9b2b4") pod "faf79fe4-a167-4cb6-ab3b-e881415fd95c" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c"). InnerVolumeSpecName "kube-api-access-9b2b4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:40:33.434578 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.434549    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "faf79fe4-a167-4cb6-ab3b-e881415fd95c" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:40:33.440702 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.440677    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faf79fe4-a167-4cb6-ab3b-e881415fd95c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "faf79fe4-a167-4cb6-ab3b-e881415fd95c" (UID: "faf79fe4-a167-4cb6-ab3b-e881415fd95c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:40:33.533278 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.533252    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/faf79fe4-a167-4cb6-ab3b-e881415fd95c-trusted-ca\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:40:33.533278 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.533276    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-registry-tls\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:40:33.533278 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.533285    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/faf79fe4-a167-4cb6-ab3b-e881415fd95c-ca-trust-extracted\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:40:33.533454 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.533294    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-installation-pull-secrets\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:40:33.533454 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.533303    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-bound-sa-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:40:33.533454 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.533311    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b2b4\" (UniqueName: \"kubernetes.io/projected/faf79fe4-a167-4cb6-ab3b-e881415fd95c-kube-api-access-9b2b4\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:40:33.533454 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:33.533319    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/faf79fe4-a167-4cb6-ab3b-e881415fd95c-image-registry-private-configuration\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:40:34.156216 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:34.156183    2563 generic.go:356] "Generic (PLEG): container finished" podID="faf79fe4-a167-4cb6-ab3b-e881415fd95c" containerID="9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5" exitCode=0
Jul 16 21:40:34.156384 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:34.156232    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4"
Jul 16 21:40:34.156384 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:34.156278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4" event={"ID":"faf79fe4-a167-4cb6-ab3b-e881415fd95c","Type":"ContainerDied","Data":"9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5"}
Jul 16 21:40:34.156384 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:34.156349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fc97bfd7-r6tt4" event={"ID":"faf79fe4-a167-4cb6-ab3b-e881415fd95c","Type":"ContainerDied","Data":"90abec44b61f9cef0dfbcd4fe05b35161cb1c1ef68fadbe6d95747be2fe8ef14"}
Jul 16 21:40:34.156384 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:34.156376    2563 scope.go:117] "RemoveContainer" containerID="9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5"
Jul 16 21:40:34.166553 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:34.166529    2563 scope.go:117] "RemoveContainer" containerID="9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5"
Jul 16 21:40:34.166808 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:40:34.166787    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5\": container with ID starting with 9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5 not found: ID does not exist" containerID="9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5"
Jul 16 21:40:34.166864 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:34.166817    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5"} err="failed to get container status \"9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5\": rpc error: code = NotFound desc = could not find container \"9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5\": container with ID starting with 9b80a4182641448ab996eac4f62feadc2e551c5edd31f7fcea34f984088425f5 not found: ID does not exist"
Jul 16 21:40:34.172677 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:34.172656    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fc97bfd7-r6tt4"]
Jul 16 21:40:34.177520 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:34.177501    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fc97bfd7-r6tt4"]
Jul 16 21:40:35.671738 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:35.671702    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faf79fe4-a167-4cb6-ab3b-e881415fd95c" path="/var/lib/kubelet/pods/faf79fe4-a167-4cb6-ab3b-e881415fd95c/volumes"
Jul 16 21:40:42.069012 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:40:42.068982    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2sblr"
Jul 16 21:43:02.272337 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.272301    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"]
Jul 16 21:43:02.272754 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.272555    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faf79fe4-a167-4cb6-ab3b-e881415fd95c" containerName="registry"
Jul 16 21:43:02.272754 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.272567    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="faf79fe4-a167-4cb6-ab3b-e881415fd95c" containerName="registry"
Jul 16 21:43:02.272754 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.272622    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="faf79fe4-a167-4cb6-ab3b-e881415fd95c" containerName="registry"
Jul 16 21:43:02.274759 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.274741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.277213 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.277193    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 21:43:02.277872 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.277857    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 21:43:02.277925 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.277885    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9g4c5\""
Jul 16 21:43:02.287026 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.287005    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"]
Jul 16 21:43:02.334046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.334022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.334046 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.334047    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.334206 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.334115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwt7q\" (UniqueName: \"kubernetes.io/projected/21fd454d-0dca-4af7-a020-73d4a9e69d8b-kube-api-access-mwt7q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.435323 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.435294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwt7q\" (UniqueName: \"kubernetes.io/projected/21fd454d-0dca-4af7-a020-73d4a9e69d8b-kube-api-access-mwt7q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.435448 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.435346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.435448 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.435366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.435658 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.435640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.435701 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.435672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.444334 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.444312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwt7q\" (UniqueName: \"kubernetes.io/projected/21fd454d-0dca-4af7-a020-73d4a9e69d8b-kube-api-access-mwt7q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.583630 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.583562    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:02.707181 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:02.707051    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"]
Jul 16 21:43:02.709605 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:43:02.709580    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fd454d_0dca_4af7_a020_73d4a9e69d8b.slice/crio-65026cd477d28f7fe14cdc9f1cddc43b679b0faaa7ffa3aea888426465213b55 WatchSource:0}: Error finding container 65026cd477d28f7fe14cdc9f1cddc43b679b0faaa7ffa3aea888426465213b55: Status 404 returned error can't find the container with id 65026cd477d28f7fe14cdc9f1cddc43b679b0faaa7ffa3aea888426465213b55
Jul 16 21:43:03.646294 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:03.646253    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd" event={"ID":"21fd454d-0dca-4af7-a020-73d4a9e69d8b","Type":"ContainerStarted","Data":"65026cd477d28f7fe14cdc9f1cddc43b679b0faaa7ffa3aea888426465213b55"}
Jul 16 21:43:09.668329 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:09.668291    2563 generic.go:356] "Generic (PLEG): container finished" podID="21fd454d-0dca-4af7-a020-73d4a9e69d8b" containerID="de41b23597d8cdd1c1ef50b17ed89226d2a46a35246c6928225d745fe91d0930" exitCode=0
Jul 16 21:43:09.671335 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:09.671302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd" event={"ID":"21fd454d-0dca-4af7-a020-73d4a9e69d8b","Type":"ContainerDied","Data":"de41b23597d8cdd1c1ef50b17ed89226d2a46a35246c6928225d745fe91d0930"}
Jul 16 21:43:12.680723 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:12.680688    2563 generic.go:356] "Generic (PLEG): container finished" podID="21fd454d-0dca-4af7-a020-73d4a9e69d8b" containerID="4b797cc56c0d395a2a97051554abd42b77f737c727980e899549a54c8ff6e9be" exitCode=0
Jul 16 21:43:12.681120 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:12.680731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd" event={"ID":"21fd454d-0dca-4af7-a020-73d4a9e69d8b","Type":"ContainerDied","Data":"4b797cc56c0d395a2a97051554abd42b77f737c727980e899549a54c8ff6e9be"}
Jul 16 21:43:20.713389 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:20.713348    2563 generic.go:356] "Generic (PLEG): container finished" podID="21fd454d-0dca-4af7-a020-73d4a9e69d8b" containerID="a97bae770a55e62d7dcefab6d57e5be19070564a052201d3fb66418c61a6c343" exitCode=0
Jul 16 21:43:20.713825 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:20.713394    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd" event={"ID":"21fd454d-0dca-4af7-a020-73d4a9e69d8b","Type":"ContainerDied","Data":"a97bae770a55e62d7dcefab6d57e5be19070564a052201d3fb66418c61a6c343"}
Jul 16 21:43:21.836755 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:21.836735    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:21.993329 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:21.993242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-util\") pod \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") "
Jul 16 21:43:21.993329 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:21.993306    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwt7q\" (UniqueName: \"kubernetes.io/projected/21fd454d-0dca-4af7-a020-73d4a9e69d8b-kube-api-access-mwt7q\") pod \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") "
Jul 16 21:43:21.993539 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:21.993362    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-bundle\") pod \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\" (UID: \"21fd454d-0dca-4af7-a020-73d4a9e69d8b\") "
Jul 16 21:43:21.993993 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:21.993965    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-bundle" (OuterVolumeSpecName: "bundle") pod "21fd454d-0dca-4af7-a020-73d4a9e69d8b" (UID: "21fd454d-0dca-4af7-a020-73d4a9e69d8b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:43:21.995528 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:21.995494    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21fd454d-0dca-4af7-a020-73d4a9e69d8b-kube-api-access-mwt7q" (OuterVolumeSpecName: "kube-api-access-mwt7q") pod "21fd454d-0dca-4af7-a020-73d4a9e69d8b" (UID: "21fd454d-0dca-4af7-a020-73d4a9e69d8b"). InnerVolumeSpecName "kube-api-access-mwt7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:43:21.997449 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:21.997424    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-util" (OuterVolumeSpecName: "util") pod "21fd454d-0dca-4af7-a020-73d4a9e69d8b" (UID: "21fd454d-0dca-4af7-a020-73d4a9e69d8b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:43:22.094520 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:22.094493    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwt7q\" (UniqueName: \"kubernetes.io/projected/21fd454d-0dca-4af7-a020-73d4a9e69d8b-kube-api-access-mwt7q\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:43:22.094520 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:22.094514    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:43:22.094520 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:22.094523    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21fd454d-0dca-4af7-a020-73d4a9e69d8b-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:43:22.721834 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:22.721800    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd" event={"ID":"21fd454d-0dca-4af7-a020-73d4a9e69d8b","Type":"ContainerDied","Data":"65026cd477d28f7fe14cdc9f1cddc43b679b0faaa7ffa3aea888426465213b55"}
Jul 16 21:43:22.721834 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:22.721833    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540cwqvd"
Jul 16 21:43:22.722091 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:22.721845    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65026cd477d28f7fe14cdc9f1cddc43b679b0faaa7ffa3aea888426465213b55"
Jul 16 21:43:34.574210 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.574130    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"]
Jul 16 21:43:34.574568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.574364    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fd454d-0dca-4af7-a020-73d4a9e69d8b" containerName="pull"
Jul 16 21:43:34.574568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.574375    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fd454d-0dca-4af7-a020-73d4a9e69d8b" containerName="pull"
Jul 16 21:43:34.574568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.574387    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fd454d-0dca-4af7-a020-73d4a9e69d8b" containerName="util"
Jul 16 21:43:34.574568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.574392    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fd454d-0dca-4af7-a020-73d4a9e69d8b" containerName="util"
Jul 16 21:43:34.574568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.574404    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fd454d-0dca-4af7-a020-73d4a9e69d8b" containerName="extract"
Jul 16 21:43:34.574568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.574409    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fd454d-0dca-4af7-a020-73d4a9e69d8b" containerName="extract"
Jul 16 21:43:34.574568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.574449    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="21fd454d-0dca-4af7-a020-73d4a9e69d8b" containerName="extract"
Jul 16 21:43:34.576485 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.576470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:34.579842 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.579821    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 21:43:34.579932 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.579827    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9g4c5\""
Jul 16 21:43:34.584782 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.584758    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 21:43:34.600547 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.600514    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"]
Jul 16 21:43:34.679509 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.679479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh2fz\" (UniqueName: \"kubernetes.io/projected/2d6cbb40-1593-407f-9e6f-200437032333-kube-api-access-hh2fz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:34.679646 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.679536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:34.679646 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.679584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:34.779951 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.779903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh2fz\" (UniqueName: \"kubernetes.io/projected/2d6cbb40-1593-407f-9e6f-200437032333-kube-api-access-hh2fz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:34.780115 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.779991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:34.780115 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.780019    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:34.780360 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.780337    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:34.780428 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.780389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:34.788020 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.787991    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh2fz\" (UniqueName: \"kubernetes.io/projected/2d6cbb40-1593-407f-9e6f-200437032333-kube-api-access-hh2fz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:34.884749 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:34.884687    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:35.011275 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:35.011246    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"]
Jul 16 21:43:35.014179 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:43:35.014153    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6cbb40_1593_407f_9e6f_200437032333.slice/crio-97662f6aec159a3de5b70279735b4982c676994a6ea3080405c79b011a3df687 WatchSource:0}: Error finding container 97662f6aec159a3de5b70279735b4982c676994a6ea3080405c79b011a3df687: Status 404 returned error can't find the container with id 97662f6aec159a3de5b70279735b4982c676994a6ea3080405c79b011a3df687
Jul 16 21:43:35.763560 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:35.763524    2563 generic.go:356] "Generic (PLEG): container finished" podID="2d6cbb40-1593-407f-9e6f-200437032333" containerID="3a688e657515d56ff536935d1a995c0c58801b33ffa3101a23b67e5ad8d7784d" exitCode=0
Jul 16 21:43:35.764056 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:35.763570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262" event={"ID":"2d6cbb40-1593-407f-9e6f-200437032333","Type":"ContainerDied","Data":"3a688e657515d56ff536935d1a995c0c58801b33ffa3101a23b67e5ad8d7784d"}
Jul 16 21:43:35.764056 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:35.763604    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262" event={"ID":"2d6cbb40-1593-407f-9e6f-200437032333","Type":"ContainerStarted","Data":"97662f6aec159a3de5b70279735b4982c676994a6ea3080405c79b011a3df687"}
Jul 16 21:43:38.776796 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:38.776758    2563 generic.go:356] "Generic (PLEG): container finished" podID="2d6cbb40-1593-407f-9e6f-200437032333" containerID="89ef35acdcc5603a3f2e4b81e61a88dbd7034b40a6eb145414e1f4bb8ad72cb6" exitCode=0
Jul 16 21:43:38.777271 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:38.776850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262" event={"ID":"2d6cbb40-1593-407f-9e6f-200437032333","Type":"ContainerDied","Data":"89ef35acdcc5603a3f2e4b81e61a88dbd7034b40a6eb145414e1f4bb8ad72cb6"}
Jul 16 21:43:39.786505 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:39.786474    2563 generic.go:356] "Generic (PLEG): container finished" podID="2d6cbb40-1593-407f-9e6f-200437032333" containerID="819c1556ec50deb32cef87b624d585bf1c57bad3e5cfaf781a85dc7ec6e8a8cf" exitCode=0
Jul 16 21:43:39.786974 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:39.786528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262" event={"ID":"2d6cbb40-1593-407f-9e6f-200437032333","Type":"ContainerDied","Data":"819c1556ec50deb32cef87b624d585bf1c57bad3e5cfaf781a85dc7ec6e8a8cf"}
Jul 16 21:43:40.915173 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:40.915148    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:41.022919 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.022889    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-util\") pod \"2d6cbb40-1593-407f-9e6f-200437032333\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") "
Jul 16 21:43:41.023098 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.022959    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-bundle\") pod \"2d6cbb40-1593-407f-9e6f-200437032333\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") "
Jul 16 21:43:41.023098 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.023016    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh2fz\" (UniqueName: \"kubernetes.io/projected/2d6cbb40-1593-407f-9e6f-200437032333-kube-api-access-hh2fz\") pod \"2d6cbb40-1593-407f-9e6f-200437032333\" (UID: \"2d6cbb40-1593-407f-9e6f-200437032333\") "
Jul 16 21:43:41.023331 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.023306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-bundle" (OuterVolumeSpecName: "bundle") pod "2d6cbb40-1593-407f-9e6f-200437032333" (UID: "2d6cbb40-1593-407f-9e6f-200437032333"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:43:41.025401 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.025365    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d6cbb40-1593-407f-9e6f-200437032333-kube-api-access-hh2fz" (OuterVolumeSpecName: "kube-api-access-hh2fz") pod "2d6cbb40-1593-407f-9e6f-200437032333" (UID: "2d6cbb40-1593-407f-9e6f-200437032333"). InnerVolumeSpecName "kube-api-access-hh2fz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:43:41.028033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.027995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-util" (OuterVolumeSpecName: "util") pod "2d6cbb40-1593-407f-9e6f-200437032333" (UID: "2d6cbb40-1593-407f-9e6f-200437032333"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:43:41.123884 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.123827    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:43:41.123884 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.123850    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh2fz\" (UniqueName: \"kubernetes.io/projected/2d6cbb40-1593-407f-9e6f-200437032333-kube-api-access-hh2fz\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:43:41.123884 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.123860    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d6cbb40-1593-407f-9e6f-200437032333-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:43:41.794276 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.794251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262" event={"ID":"2d6cbb40-1593-407f-9e6f-200437032333","Type":"ContainerDied","Data":"97662f6aec159a3de5b70279735b4982c676994a6ea3080405c79b011a3df687"}
Jul 16 21:43:41.794415 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.794290    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97662f6aec159a3de5b70279735b4982c676994a6ea3080405c79b011a3df687"
Jul 16 21:43:41.794415 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:41.794260    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5k262"
Jul 16 21:43:48.334150 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.334119    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"]
Jul 16 21:43:48.334515 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.334348    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d6cbb40-1593-407f-9e6f-200437032333" containerName="util"
Jul 16 21:43:48.334515 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.334358    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d6cbb40-1593-407f-9e6f-200437032333" containerName="util"
Jul 16 21:43:48.334515 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.334367    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d6cbb40-1593-407f-9e6f-200437032333" containerName="pull"
Jul 16 21:43:48.334515 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.334372    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d6cbb40-1593-407f-9e6f-200437032333" containerName="pull"
Jul 16 21:43:48.334515 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.334379    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d6cbb40-1593-407f-9e6f-200437032333" containerName="extract"
Jul 16 21:43:48.334515 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.334384    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d6cbb40-1593-407f-9e6f-200437032333" containerName="extract"
Jul 16 21:43:48.334515 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.334427    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d6cbb40-1593-407f-9e6f-200437032333" containerName="extract"
Jul 16 21:43:48.354831 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.354804    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"]
Jul 16 21:43:48.354976 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.354853    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"
Jul 16 21:43:48.357534 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.357517    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-vxgpv\""
Jul 16 21:43:48.357830 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.357814    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 21:43:48.358176 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.358158    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 21:43:48.475190 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.475160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p958s\" (UniqueName: \"kubernetes.io/projected/40015843-3759-4852-8832-0343a13facdb-kube-api-access-p958s\") pod \"openshift-lws-operator-fd8ccff4c-m4fck\" (UID: \"40015843-3759-4852-8832-0343a13facdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"
Jul 16 21:43:48.475341 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.475197    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40015843-3759-4852-8832-0343a13facdb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m4fck\" (UID: \"40015843-3759-4852-8832-0343a13facdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"
Jul 16 21:43:48.575748 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.575713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p958s\" (UniqueName: \"kubernetes.io/projected/40015843-3759-4852-8832-0343a13facdb-kube-api-access-p958s\") pod \"openshift-lws-operator-fd8ccff4c-m4fck\" (UID: \"40015843-3759-4852-8832-0343a13facdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"
Jul 16 21:43:48.575882 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.575758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40015843-3759-4852-8832-0343a13facdb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m4fck\" (UID: \"40015843-3759-4852-8832-0343a13facdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"
Jul 16 21:43:48.576099 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.576084    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40015843-3759-4852-8832-0343a13facdb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-m4fck\" (UID: \"40015843-3759-4852-8832-0343a13facdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"
Jul 16 21:43:48.584529 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.584469    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p958s\" (UniqueName: \"kubernetes.io/projected/40015843-3759-4852-8832-0343a13facdb-kube-api-access-p958s\") pod \"openshift-lws-operator-fd8ccff4c-m4fck\" (UID: \"40015843-3759-4852-8832-0343a13facdb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"
Jul 16 21:43:48.663330 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.663285    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"
Jul 16 21:43:48.805410 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.805380    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck"]
Jul 16 21:43:48.818125 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:48.818100    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck" event={"ID":"40015843-3759-4852-8832-0343a13facdb","Type":"ContainerStarted","Data":"60c66f9150eba6247ab9096f9ccfdf1aabac7c190a6e3473d32e7375c2df4fff"}
Jul 16 21:43:51.830364 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:51.830329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck" event={"ID":"40015843-3759-4852-8832-0343a13facdb","Type":"ContainerStarted","Data":"e37b842f7925b6528e33ccec3ced5a4b83be27c40e1ce3dfc48d8556b6210432"}
Jul 16 21:43:51.848288 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:51.848242    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-m4fck" podStartSLOduration=1.7892224429999999 podStartE2EDuration="3.848228721s" totalImagesPullingTime="2.059006278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:43:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:43:51.847730089 +0000 UTC m=+296.673375388" watchObservedRunningTime="2026-07-16 21:43:51.848228721 +0000 UTC m=+296.673874021"
Jul 16 21:43:54.181729 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.181695    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"]
Jul 16 21:43:54.184334 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.184318    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.186637 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.186616    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9g4c5\""
Jul 16 21:43:54.186858 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.186845    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 21:43:54.187513 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.187497    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 21:43:54.193557 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.193539    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"]
Jul 16 21:43:54.213746 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.213721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl7kx\" (UniqueName: \"kubernetes.io/projected/e745e36d-42ca-41bf-87b9-621cb2e9b492-kube-api-access-kl7kx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.213850 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.213760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.213850 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.213778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.314159 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.314129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl7kx\" (UniqueName: \"kubernetes.io/projected/e745e36d-42ca-41bf-87b9-621cb2e9b492-kube-api-access-kl7kx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.314295 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.314186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.314295 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.314214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.314555 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.314536    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.314613 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.314599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.322789 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.322768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl7kx\" (UniqueName: \"kubernetes.io/projected/e745e36d-42ca-41bf-87b9-621cb2e9b492-kube-api-access-kl7kx\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.493057 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.492980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:54.617930 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.617908    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"]
Jul 16 21:43:54.619854 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:43:54.619824    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode745e36d_42ca_41bf_87b9_621cb2e9b492.slice/crio-7d02e1a380a0d2985d6fc2035908e2b8865bac1c7fd3efbfd08b91e25d87b29c WatchSource:0}: Error finding container 7d02e1a380a0d2985d6fc2035908e2b8865bac1c7fd3efbfd08b91e25d87b29c: Status 404 returned error can't find the container with id 7d02e1a380a0d2985d6fc2035908e2b8865bac1c7fd3efbfd08b91e25d87b29c
Jul 16 21:43:54.842335 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.842270    2563 generic.go:356] "Generic (PLEG): container finished" podID="e745e36d-42ca-41bf-87b9-621cb2e9b492" containerID="66f531403bd1c786c7616a2f82dc8b68e9276326e9eb40c7a882de6749332aa5" exitCode=0
Jul 16 21:43:54.842450 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.842356    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj" event={"ID":"e745e36d-42ca-41bf-87b9-621cb2e9b492","Type":"ContainerDied","Data":"66f531403bd1c786c7616a2f82dc8b68e9276326e9eb40c7a882de6749332aa5"}
Jul 16 21:43:54.842450 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:54.842403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj" event={"ID":"e745e36d-42ca-41bf-87b9-621cb2e9b492","Type":"ContainerStarted","Data":"7d02e1a380a0d2985d6fc2035908e2b8865bac1c7fd3efbfd08b91e25d87b29c"}
Jul 16 21:43:55.550137 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:55.550106    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 21:43:55.847568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:55.847538    2563 generic.go:356] "Generic (PLEG): container finished" podID="e745e36d-42ca-41bf-87b9-621cb2e9b492" containerID="51ccab70747c1413a3c6ece9ed6e34526b8c3d88b392a8317632bc478fec38ef" exitCode=0
Jul 16 21:43:55.849027 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:55.847590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj" event={"ID":"e745e36d-42ca-41bf-87b9-621cb2e9b492","Type":"ContainerDied","Data":"51ccab70747c1413a3c6ece9ed6e34526b8c3d88b392a8317632bc478fec38ef"}
Jul 16 21:43:56.853197 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:56.853166    2563 generic.go:356] "Generic (PLEG): container finished" podID="e745e36d-42ca-41bf-87b9-621cb2e9b492" containerID="968dbd85f53e1b47723f23692c60539915e48e9e928563b732c6fe7c5ad65e34" exitCode=0
Jul 16 21:43:56.853585 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:56.853250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj" event={"ID":"e745e36d-42ca-41bf-87b9-621cb2e9b492","Type":"ContainerDied","Data":"968dbd85f53e1b47723f23692c60539915e48e9e928563b732c6fe7c5ad65e34"}
Jul 16 21:43:57.987776 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:57.987752    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:43:58.040354 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.040332    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-util\") pod \"e745e36d-42ca-41bf-87b9-621cb2e9b492\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") "
Jul 16 21:43:58.040487 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.040362    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-bundle\") pod \"e745e36d-42ca-41bf-87b9-621cb2e9b492\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") "
Jul 16 21:43:58.040487 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.040404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kl7kx\" (UniqueName: \"kubernetes.io/projected/e745e36d-42ca-41bf-87b9-621cb2e9b492-kube-api-access-kl7kx\") pod \"e745e36d-42ca-41bf-87b9-621cb2e9b492\" (UID: \"e745e36d-42ca-41bf-87b9-621cb2e9b492\") "
Jul 16 21:43:58.041131 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.041049    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-bundle" (OuterVolumeSpecName: "bundle") pod "e745e36d-42ca-41bf-87b9-621cb2e9b492" (UID: "e745e36d-42ca-41bf-87b9-621cb2e9b492"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:43:58.042506 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.042483    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e745e36d-42ca-41bf-87b9-621cb2e9b492-kube-api-access-kl7kx" (OuterVolumeSpecName: "kube-api-access-kl7kx") pod "e745e36d-42ca-41bf-87b9-621cb2e9b492" (UID: "e745e36d-42ca-41bf-87b9-621cb2e9b492"). InnerVolumeSpecName "kube-api-access-kl7kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:43:58.046042 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.046003    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-util" (OuterVolumeSpecName: "util") pod "e745e36d-42ca-41bf-87b9-621cb2e9b492" (UID: "e745e36d-42ca-41bf-87b9-621cb2e9b492"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:43:58.141377 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.141326    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:43:58.141377 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.141344    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e745e36d-42ca-41bf-87b9-621cb2e9b492-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:43:58.141377 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.141352    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kl7kx\" (UniqueName: \"kubernetes.io/projected/e745e36d-42ca-41bf-87b9-621cb2e9b492-kube-api-access-kl7kx\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:43:58.862477 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.862448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj" event={"ID":"e745e36d-42ca-41bf-87b9-621cb2e9b492","Type":"ContainerDied","Data":"7d02e1a380a0d2985d6fc2035908e2b8865bac1c7fd3efbfd08b91e25d87b29c"}
Jul 16 21:43:58.862636 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.862497    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d02e1a380a0d2985d6fc2035908e2b8865bac1c7fd3efbfd08b91e25d87b29c"
Jul 16 21:43:58.862636 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:43:58.862457    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff2bxj"
Jul 16 21:44:09.131823 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.131793    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"]
Jul 16 21:44:09.132246 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.132039    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e745e36d-42ca-41bf-87b9-621cb2e9b492" containerName="extract"
Jul 16 21:44:09.132246 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.132050    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e745e36d-42ca-41bf-87b9-621cb2e9b492" containerName="extract"
Jul 16 21:44:09.132246 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.132061    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e745e36d-42ca-41bf-87b9-621cb2e9b492" containerName="util"
Jul 16 21:44:09.132246 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.132067    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e745e36d-42ca-41bf-87b9-621cb2e9b492" containerName="util"
Jul 16 21:44:09.132246 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.132074    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e745e36d-42ca-41bf-87b9-621cb2e9b492" containerName="pull"
Jul 16 21:44:09.132246 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.132078    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e745e36d-42ca-41bf-87b9-621cb2e9b492" containerName="pull"
Jul 16 21:44:09.132246 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.132133    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e745e36d-42ca-41bf-87b9-621cb2e9b492" containerName="extract"
Jul 16 21:44:09.134843 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.134823    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.137183 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.137167    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 21:44:09.137507 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.137487    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 21:44:09.137992 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.137975    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 21:44:09.138068 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.137988    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 21:44:09.138068 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.137976    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-htzmn\""
Jul 16 21:44:09.160756 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.160727    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"]
Jul 16 21:44:09.218252 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.218228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1583df3d-dea4-4935-bc8d-d647981197de-webhook-cert\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.218355 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.218271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1583df3d-dea4-4935-bc8d-d647981197de-manifests\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.218355 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.218291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1583df3d-dea4-4935-bc8d-d647981197de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.218422 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.218371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vmpg\" (UniqueName: \"kubernetes.io/projected/1583df3d-dea4-4935-bc8d-d647981197de-kube-api-access-4vmpg\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.218422 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.218395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1583df3d-dea4-4935-bc8d-d647981197de-tmp\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.319568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.319540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vmpg\" (UniqueName: \"kubernetes.io/projected/1583df3d-dea4-4935-bc8d-d647981197de-kube-api-access-4vmpg\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.319568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.319570    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1583df3d-dea4-4935-bc8d-d647981197de-tmp\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.319764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.319589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1583df3d-dea4-4935-bc8d-d647981197de-webhook-cert\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.319764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.319633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1583df3d-dea4-4935-bc8d-d647981197de-manifests\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.319861 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.319760    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1583df3d-dea4-4935-bc8d-d647981197de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.320038 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.320006    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1583df3d-dea4-4935-bc8d-d647981197de-manifests\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.322097 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.322072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1583df3d-dea4-4935-bc8d-d647981197de-tmp\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.322244 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.322229    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1583df3d-dea4-4935-bc8d-d647981197de-apiservice-cert\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.322304 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.322263    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1583df3d-dea4-4935-bc8d-d647981197de-webhook-cert\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.328760 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.328739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vmpg\" (UniqueName: \"kubernetes.io/projected/1583df3d-dea4-4935-bc8d-d647981197de-kube-api-access-4vmpg\") pod \"opendatahub-operator-controller-manager-db5748bcb-qh7fr\" (UID: \"1583df3d-dea4-4935-bc8d-d647981197de\") " pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.444865 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.444840    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:09.595914 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.595890    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"]
Jul 16 21:44:09.598299 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:44:09.598276    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1583df3d_dea4_4935_bc8d_d647981197de.slice/crio-ca91809d9d0557ac0d47ada9d114a41fe5f58d27ff728438f30cc4fba043ebb4 WatchSource:0}: Error finding container ca91809d9d0557ac0d47ada9d114a41fe5f58d27ff728438f30cc4fba043ebb4: Status 404 returned error can't find the container with id ca91809d9d0557ac0d47ada9d114a41fe5f58d27ff728438f30cc4fba043ebb4
Jul 16 21:44:09.600226 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.600210    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:44:09.902042 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:09.901961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr" event={"ID":"1583df3d-dea4-4935-bc8d-d647981197de","Type":"ContainerStarted","Data":"ca91809d9d0557ac0d47ada9d114a41fe5f58d27ff728438f30cc4fba043ebb4"}
Jul 16 21:44:13.921333 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:13.921304    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr" event={"ID":"1583df3d-dea4-4935-bc8d-d647981197de","Type":"ContainerStarted","Data":"f7ac909c4f770971a03208ad7c7f83a41b08df9bbfe3226edd6bd6ffdad76b23"}
Jul 16 21:44:14.928862 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:14.928829    2563 generic.go:356] "Generic (PLEG): container finished" podID="1583df3d-dea4-4935-bc8d-d647981197de" containerID="f7ac909c4f770971a03208ad7c7f83a41b08df9bbfe3226edd6bd6ffdad76b23" exitCode=0
Jul 16 21:44:14.929256 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:14.928912    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr" event={"ID":"1583df3d-dea4-4935-bc8d-d647981197de","Type":"ContainerDied","Data":"f7ac909c4f770971a03208ad7c7f83a41b08df9bbfe3226edd6bd6ffdad76b23"}
Jul 16 21:44:15.934723 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:15.934689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr" event={"ID":"1583df3d-dea4-4935-bc8d-d647981197de","Type":"ContainerStarted","Data":"f7a6cbad2006d1f54af2e6eacaacfc4dcb9551af3c527a20165ffee7c0740ada"}
Jul 16 21:44:15.935222 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:15.934822    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:15.959026 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:15.958845    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr" podStartSLOduration=1.887363181 podStartE2EDuration="6.958832078s" totalImagesPullingTime="4.006946168s" totalInitContainerRuntime="1.064522729s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:44:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:44:15.957330507 +0000 UTC m=+320.782975808" watchObservedRunningTime="2026-07-16 21:44:15.958832078 +0000 UTC m=+320.784477378"
Jul 16 21:44:26.940676 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:26.940649    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-db5748bcb-qh7fr"
Jul 16 21:44:29.325089 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.325054    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"]
Jul 16 21:44:29.332855 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.332832    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:29.340844 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.340826    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 21:44:29.342381 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.342367    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 21:44:29.343429 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.343415    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 21:44:29.343586 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.343575    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 21:44:29.368807 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.368786    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4hh8\" (UniqueName: \"kubernetes.io/projected/2fe08dd5-9fbb-4a04-aea2-663872bf0063-kube-api-access-c4hh8\") pod \"kube-auth-proxy-67b5c5c797-9c75x\" (UID: \"2fe08dd5-9fbb-4a04-aea2-663872bf0063\") " pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:29.368897 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.368813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fe08dd5-9fbb-4a04-aea2-663872bf0063-tls-certs\") pod \"kube-auth-proxy-67b5c5c797-9c75x\" (UID: \"2fe08dd5-9fbb-4a04-aea2-663872bf0063\") " pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:29.368897 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.368835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fe08dd5-9fbb-4a04-aea2-663872bf0063-tmp\") pod \"kube-auth-proxy-67b5c5c797-9c75x\" (UID: \"2fe08dd5-9fbb-4a04-aea2-663872bf0063\") " pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:29.442616 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.442590    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"]
Jul 16 21:44:29.470252 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.470225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4hh8\" (UniqueName: \"kubernetes.io/projected/2fe08dd5-9fbb-4a04-aea2-663872bf0063-kube-api-access-c4hh8\") pod \"kube-auth-proxy-67b5c5c797-9c75x\" (UID: \"2fe08dd5-9fbb-4a04-aea2-663872bf0063\") " pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:29.470252 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.470254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fe08dd5-9fbb-4a04-aea2-663872bf0063-tls-certs\") pod \"kube-auth-proxy-67b5c5c797-9c75x\" (UID: \"2fe08dd5-9fbb-4a04-aea2-663872bf0063\") " pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:29.470436 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.470276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fe08dd5-9fbb-4a04-aea2-663872bf0063-tmp\") pod \"kube-auth-proxy-67b5c5c797-9c75x\" (UID: \"2fe08dd5-9fbb-4a04-aea2-663872bf0063\") " pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:29.470436 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:44:29.470394    2563 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 16 21:44:29.470534 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:44:29.470479    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fe08dd5-9fbb-4a04-aea2-663872bf0063-tls-certs podName:2fe08dd5-9fbb-4a04-aea2-663872bf0063 nodeName:}" failed. No retries permitted until 2026-07-16 21:44:29.970458736 +0000 UTC m=+334.796104027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2fe08dd5-9fbb-4a04-aea2-663872bf0063-tls-certs") pod "kube-auth-proxy-67b5c5c797-9c75x" (UID: "2fe08dd5-9fbb-4a04-aea2-663872bf0063") : secret "kube-auth-proxy-tls" not found
Jul 16 21:44:29.472650 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.472620    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2fe08dd5-9fbb-4a04-aea2-663872bf0063-tmp\") pod \"kube-auth-proxy-67b5c5c797-9c75x\" (UID: \"2fe08dd5-9fbb-4a04-aea2-663872bf0063\") " pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:29.492531 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.492510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4hh8\" (UniqueName: \"kubernetes.io/projected/2fe08dd5-9fbb-4a04-aea2-663872bf0063-kube-api-access-c4hh8\") pod \"kube-auth-proxy-67b5c5c797-9c75x\" (UID: \"2fe08dd5-9fbb-4a04-aea2-663872bf0063\") " pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:29.973295 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.973262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fe08dd5-9fbb-4a04-aea2-663872bf0063-tls-certs\") pod \"kube-auth-proxy-67b5c5c797-9c75x\" (UID: \"2fe08dd5-9fbb-4a04-aea2-663872bf0063\") " pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:29.975654 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:29.975622    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fe08dd5-9fbb-4a04-aea2-663872bf0063-tls-certs\") pod \"kube-auth-proxy-67b5c5c797-9c75x\" (UID: \"2fe08dd5-9fbb-4a04-aea2-663872bf0063\") " pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:30.092033 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.092002    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kgf9p"]
Jul 16 21:44:30.095199 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.095184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:30.104753 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.104731    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 16 21:44:30.104851 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.104798    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4znt7\""
Jul 16 21:44:30.120562 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.120540    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kgf9p"]
Jul 16 21:44:30.175250 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.175230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b750a5-b46e-416a-9b03-1f4c0f76814c-cert\") pod \"odh-model-controller-7998c67dc4-kgf9p\" (UID: \"f5b750a5-b46e-416a-9b03-1f4c0f76814c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:30.175380 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.175280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdqjk\" (UniqueName: \"kubernetes.io/projected/f5b750a5-b46e-416a-9b03-1f4c0f76814c-kube-api-access-vdqjk\") pod \"odh-model-controller-7998c67dc4-kgf9p\" (UID: \"f5b750a5-b46e-416a-9b03-1f4c0f76814c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:30.241457 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.241381    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"
Jul 16 21:44:30.276614 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.276578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdqjk\" (UniqueName: \"kubernetes.io/projected/f5b750a5-b46e-416a-9b03-1f4c0f76814c-kube-api-access-vdqjk\") pod \"odh-model-controller-7998c67dc4-kgf9p\" (UID: \"f5b750a5-b46e-416a-9b03-1f4c0f76814c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:30.276788 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.276653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b750a5-b46e-416a-9b03-1f4c0f76814c-cert\") pod \"odh-model-controller-7998c67dc4-kgf9p\" (UID: \"f5b750a5-b46e-416a-9b03-1f4c0f76814c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:30.276845 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:44:30.276826    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 16 21:44:30.276981 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:44:30.276966    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5b750a5-b46e-416a-9b03-1f4c0f76814c-cert podName:f5b750a5-b46e-416a-9b03-1f4c0f76814c nodeName:}" failed. No retries permitted until 2026-07-16 21:44:30.776925459 +0000 UTC m=+335.602570752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f5b750a5-b46e-416a-9b03-1f4c0f76814c-cert") pod "odh-model-controller-7998c67dc4-kgf9p" (UID: "f5b750a5-b46e-416a-9b03-1f4c0f76814c") : secret "odh-model-controller-webhook-cert" not found
Jul 16 21:44:30.306760 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.306730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdqjk\" (UniqueName: \"kubernetes.io/projected/f5b750a5-b46e-416a-9b03-1f4c0f76814c-kube-api-access-vdqjk\") pod \"odh-model-controller-7998c67dc4-kgf9p\" (UID: \"f5b750a5-b46e-416a-9b03-1f4c0f76814c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:30.426473 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.426448    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x"]
Jul 16 21:44:30.428766 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:44:30.428742    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fe08dd5_9fbb_4a04_aea2_663872bf0063.slice/crio-9240e8f00e4340106fca9d79fc4040028c993c8804e398e4be8ce81f6d34a812 WatchSource:0}: Error finding container 9240e8f00e4340106fca9d79fc4040028c993c8804e398e4be8ce81f6d34a812: Status 404 returned error can't find the container with id 9240e8f00e4340106fca9d79fc4040028c993c8804e398e4be8ce81f6d34a812
Jul 16 21:44:30.780421 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.780394    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b750a5-b46e-416a-9b03-1f4c0f76814c-cert\") pod \"odh-model-controller-7998c67dc4-kgf9p\" (UID: \"f5b750a5-b46e-416a-9b03-1f4c0f76814c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:30.782902 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.782881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5b750a5-b46e-416a-9b03-1f4c0f76814c-cert\") pod \"odh-model-controller-7998c67dc4-kgf9p\" (UID: \"f5b750a5-b46e-416a-9b03-1f4c0f76814c\") " pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:30.992716 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:30.992683    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x" event={"ID":"2fe08dd5-9fbb-4a04-aea2-663872bf0063","Type":"ContainerStarted","Data":"9240e8f00e4340106fca9d79fc4040028c993c8804e398e4be8ce81f6d34a812"}
Jul 16 21:44:31.004922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.004901    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:31.162291 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.162268    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-kgf9p"]
Jul 16 21:44:31.165090 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:44:31.165065    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b750a5_b46e_416a_9b03_1f4c0f76814c.slice/crio-2d61b32c362ba0d70636d5db19d26f8bab7d664da92dfc861c88de59ec9f820d WatchSource:0}: Error finding container 2d61b32c362ba0d70636d5db19d26f8bab7d664da92dfc861c88de59ec9f820d: Status 404 returned error can't find the container with id 2d61b32c362ba0d70636d5db19d26f8bab7d664da92dfc861c88de59ec9f820d
Jul 16 21:44:31.404342 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.404257    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6kzw6"]
Jul 16 21:44:31.407933 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.407906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:31.410751 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.410726    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 21:44:31.484903 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.484864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6eddd3-0629-4e96-9611-dabfadc5a9b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-6kzw6\" (UID: \"5a6eddd3-0629-4e96-9611-dabfadc5a9b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:31.485362 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.484963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5l44\" (UniqueName: \"kubernetes.io/projected/5a6eddd3-0629-4e96-9611-dabfadc5a9b5-kube-api-access-z5l44\") pod \"model-serving-api-54d89bd5fc-6kzw6\" (UID: \"5a6eddd3-0629-4e96-9611-dabfadc5a9b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:31.494485 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.494455    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6kzw6"]
Jul 16 21:44:31.585735 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.585701    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6eddd3-0629-4e96-9611-dabfadc5a9b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-6kzw6\" (UID: \"5a6eddd3-0629-4e96-9611-dabfadc5a9b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:31.585919 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.585778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5l44\" (UniqueName: \"kubernetes.io/projected/5a6eddd3-0629-4e96-9611-dabfadc5a9b5-kube-api-access-z5l44\") pod \"model-serving-api-54d89bd5fc-6kzw6\" (UID: \"5a6eddd3-0629-4e96-9611-dabfadc5a9b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:31.585919 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:44:31.585839    2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 16 21:44:31.585919 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:44:31.585907    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6eddd3-0629-4e96-9611-dabfadc5a9b5-tls-certs podName:5a6eddd3-0629-4e96-9611-dabfadc5a9b5 nodeName:}" failed. No retries permitted until 2026-07-16 21:44:32.085888582 +0000 UTC m=+336.911533860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5a6eddd3-0629-4e96-9611-dabfadc5a9b5-tls-certs") pod "model-serving-api-54d89bd5fc-6kzw6" (UID: "5a6eddd3-0629-4e96-9611-dabfadc5a9b5") : secret "model-serving-api-tls" not found
Jul 16 21:44:31.600989 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.600928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5l44\" (UniqueName: \"kubernetes.io/projected/5a6eddd3-0629-4e96-9611-dabfadc5a9b5-kube-api-access-z5l44\") pod \"model-serving-api-54d89bd5fc-6kzw6\" (UID: \"5a6eddd3-0629-4e96-9611-dabfadc5a9b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:31.999323 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:31.999288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p" event={"ID":"f5b750a5-b46e-416a-9b03-1f4c0f76814c","Type":"ContainerStarted","Data":"2d61b32c362ba0d70636d5db19d26f8bab7d664da92dfc861c88de59ec9f820d"}
Jul 16 21:44:32.090013 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.089978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6eddd3-0629-4e96-9611-dabfadc5a9b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-6kzw6\" (UID: \"5a6eddd3-0629-4e96-9611-dabfadc5a9b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:32.093301 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.093246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a6eddd3-0629-4e96-9611-dabfadc5a9b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-6kzw6\" (UID: \"5a6eddd3-0629-4e96-9611-dabfadc5a9b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:32.098426 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.097162    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"]
Jul 16 21:44:32.101676 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.100559    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.105512 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.105491    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 21:44:32.106175 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.105958    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 21:44:32.106175 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.106017    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 21:44:32.106175 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.106143    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-r57rk\""
Jul 16 21:44:32.106175 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.106177    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 21:44:32.133794 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.133765    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"]
Jul 16 21:44:32.191211 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.191185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-local-certs\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.191376 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.191220    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.191376 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.191255    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.191376 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.191314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jnt6\" (UniqueName: \"kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-kube-api-access-8jnt6\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.191376 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.191341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-token\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.191599 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.191439    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-cacerts\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.191599 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.191498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.292605 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.292488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-cacerts\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.292605 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.292536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.292605 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.292603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-local-certs\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.292922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.292631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.292922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.292666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.292922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.292694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jnt6\" (UniqueName: \"kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-kube-api-access-8jnt6\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.292922 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.292721    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-token\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.293669 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.293605    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.297755 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.297726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.300841 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.299585    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-local-certs\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.300841 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.300080    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.300841 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.300759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-cacerts\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.305100 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.304373    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-token\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.308134 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.308096    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jnt6\" (UniqueName: \"kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-kube-api-access-8jnt6\") pod \"istiod-openshift-gateway-7574459656-nz5nc\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.319397 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.319366    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:32.413722 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.413460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:32.501852 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:32.501794    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-6kzw6"]
Jul 16 21:44:33.158089 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:44:33.158048    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6eddd3_0629_4e96_9611_dabfadc5a9b5.slice/crio-194fc92eea7d5fa7e5ea447bdf87c38380ac9f58c83c1f20b28b72ad7d434261 WatchSource:0}: Error finding container 194fc92eea7d5fa7e5ea447bdf87c38380ac9f58c83c1f20b28b72ad7d434261: Status 404 returned error can't find the container with id 194fc92eea7d5fa7e5ea447bdf87c38380ac9f58c83c1f20b28b72ad7d434261
Jul 16 21:44:34.009284 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:34.009248    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6" event={"ID":"5a6eddd3-0629-4e96-9611-dabfadc5a9b5","Type":"ContainerStarted","Data":"194fc92eea7d5fa7e5ea447bdf87c38380ac9f58c83c1f20b28b72ad7d434261"}
Jul 16 21:44:34.531454 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:34.531423    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"]
Jul 16 21:44:34.534992 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:44:34.534961    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf150f9_ad1b_4b23_a3f3_e4bc69a7d5da.slice/crio-76d60512069df0bb68e8af0520660771f9c13f677fcc082a9580ad99533c74ea WatchSource:0}: Error finding container 76d60512069df0bb68e8af0520660771f9c13f677fcc082a9580ad99533c74ea: Status 404 returned error can't find the container with id 76d60512069df0bb68e8af0520660771f9c13f677fcc082a9580ad99533c74ea
Jul 16 21:44:35.017528 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:35.017493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc" event={"ID":"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da","Type":"ContainerStarted","Data":"76d60512069df0bb68e8af0520660771f9c13f677fcc082a9580ad99533c74ea"}
Jul 16 21:44:35.019214 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:35.019185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x" event={"ID":"2fe08dd5-9fbb-4a04-aea2-663872bf0063","Type":"ContainerStarted","Data":"0610bea691a87f5e4518e6c9fa2c76c2298ba59cd481fe6db2fcf392ba9f0880"}
Jul 16 21:44:35.020858 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:35.020833    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p" event={"ID":"f5b750a5-b46e-416a-9b03-1f4c0f76814c","Type":"ContainerStarted","Data":"2e5c50a4135703fbde5448b3d33634ff08e97dfa70a273ff841f6e907636ed0d"}
Jul 16 21:44:35.021082 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:35.021063    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:35.045351 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:35.045255    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67b5c5c797-9c75x" podStartSLOduration=2.077848431 podStartE2EDuration="6.045241157s" totalImagesPullingTime="3.967392726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:44:35.044425992 +0000 UTC m=+339.870071288" watchObservedRunningTime="2026-07-16 21:44:35.045241157 +0000 UTC m=+339.870886456"
Jul 16 21:44:35.067233 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:35.067185    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p" podStartSLOduration=1.791344859 podStartE2EDuration="5.067164102s" totalImagesPullingTime="3.275819243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:44:35.065638917 +0000 UTC m=+339.891284217" watchObservedRunningTime="2026-07-16 21:44:35.067164102 +0000 UTC m=+339.892809403"
Jul 16 21:44:36.027421 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:36.027381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6" event={"ID":"5a6eddd3-0629-4e96-9611-dabfadc5a9b5","Type":"ContainerStarted","Data":"3e9c5454bd98da16fe99f50eaf4bdf333b05a13f05ce3a61a0431af13f45941b"}
Jul 16 21:44:36.054172 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:36.054127    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6" podStartSLOduration=2.2887082899999998 podStartE2EDuration="5.054111947s" totalImagesPullingTime="2.765403657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:44:36.053575076 +0000 UTC m=+340.879220375" watchObservedRunningTime="2026-07-16 21:44:36.054111947 +0000 UTC m=+340.879757246"
Jul 16 21:44:37.032672 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:37.032641    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:37.689227 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:37.689180    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:44:37.689360 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:37.689270    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:44:38.038973 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:38.038862    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc" event={"ID":"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da","Type":"ContainerStarted","Data":"0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15"}
Jul 16 21:44:38.076408 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:38.076360    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc" podStartSLOduration=2.925287117 podStartE2EDuration="6.076345025s" totalImagesPullingTime="3.151057908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:44:38.074342784 +0000 UTC m=+342.899988084" watchObservedRunningTime="2026-07-16 21:44:38.076345025 +0000 UTC m=+342.901990325"
Jul 16 21:44:39.043071 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.043036    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:39.044594 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.044571    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-nz5nc container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 21:44:39.044688 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.044626    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc" podUID="2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 21:44:39.608054 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.608025    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"]
Jul 16 21:44:39.611193 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.611178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.613409 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.613392    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-z8vtq\""
Jul 16 21:44:39.630491 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.630469    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"]
Jul 16 21:44:39.759341 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.759309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.759341 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.759339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.759525 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.759369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.759525 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.759394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.759525 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.759411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.759525 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.759436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.759525 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.759463    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.759525 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.759487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.759710 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.759537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rbzc\" (UniqueName: \"kubernetes.io/projected/6f08a02d-b6d3-4c9c-a39a-e329bec72562-kube-api-access-9rbzc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860319 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860319 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860319 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860589 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860589 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860589 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860589 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860787 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860787 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rbzc\" (UniqueName: \"kubernetes.io/projected/6f08a02d-b6d3-4c9c-a39a-e329bec72562-kube-api-access-9rbzc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860787 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.860787 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.860766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.861056 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.861028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.861056 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.861053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.861534 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.861499    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.862739 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.862711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.863342 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.863320    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.885154 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.885125    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rbzc\" (UniqueName: \"kubernetes.io/projected/6f08a02d-b6d3-4c9c-a39a-e329bec72562-kube-api-access-9rbzc\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.885292 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.885272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f08a02d-b6d3-4c9c-a39a-e329bec72562-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4hcplq\" (UID: \"6f08a02d-b6d3-4c9c-a39a-e329bec72562\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:39.921372 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:39.921320    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:40.048233 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:40.048208    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:40.096234 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:40.096203    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"]
Jul 16 21:44:40.107968 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:44:40.107912    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f08a02d_b6d3_4c9c_a39a_e329bec72562.slice/crio-421d6ebc1694ffc0b4d63cf2a69e3e03138e27644302cf82b0b92ee80ac6d63b WatchSource:0}: Error finding container 421d6ebc1694ffc0b4d63cf2a69e3e03138e27644302cf82b0b92ee80ac6d63b: Status 404 returned error can't find the container with id 421d6ebc1694ffc0b4d63cf2a69e3e03138e27644302cf82b0b92ee80ac6d63b
Jul 16 21:44:41.055247 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.055208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq" event={"ID":"6f08a02d-b6d3-4c9c-a39a-e329bec72562","Type":"ContainerStarted","Data":"421d6ebc1694ffc0b4d63cf2a69e3e03138e27644302cf82b0b92ee80ac6d63b"}
Jul 16 21:44:41.254087 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.253629    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"]
Jul 16 21:44:41.257286 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.257260    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"]
Jul 16 21:44:41.257425 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.257386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:44:41.260712 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.260689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"
Jul 16 21:44:41.261161 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.261122    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 21:44:41.261289 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.261211    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-cmlvn\""
Jul 16 21:44:41.263726 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.263646    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-q862k\""
Jul 16 21:44:41.264007 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.263990    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 21:44:41.276530 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.276512    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"]
Jul 16 21:44:41.283271 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.283256    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"]
Jul 16 21:44:41.374753 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.374658    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrpkc\" (UniqueName: \"kubernetes.io/projected/3f167065-ce40-4e17-aaa1-ca5e9ff01c18-kube-api-access-jrpkc\") pod \"llmisvc-controller-manager-777c6bd7d5-brhs2\" (UID: \"3f167065-ce40-4e17-aaa1-ca5e9ff01c18\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"
Jul 16 21:44:41.374753 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.374740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f167065-ce40-4e17-aaa1-ca5e9ff01c18-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-brhs2\" (UID: \"3f167065-ce40-4e17-aaa1-ca5e9ff01c18\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"
Jul 16 21:44:41.375027 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.374811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sk9z\" (UniqueName: \"kubernetes.io/projected/5cf7b1da-f6a8-4fec-b894-27ab267e3c24-kube-api-access-7sk9z\") pod \"kserve-controller-manager-d6f4b65b8-qfzb2\" (UID: \"5cf7b1da-f6a8-4fec-b894-27ab267e3c24\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:44:41.375027 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.374893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cf7b1da-f6a8-4fec-b894-27ab267e3c24-cert\") pod \"kserve-controller-manager-d6f4b65b8-qfzb2\" (UID: \"5cf7b1da-f6a8-4fec-b894-27ab267e3c24\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:44:41.475599 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.475567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrpkc\" (UniqueName: \"kubernetes.io/projected/3f167065-ce40-4e17-aaa1-ca5e9ff01c18-kube-api-access-jrpkc\") pod \"llmisvc-controller-manager-777c6bd7d5-brhs2\" (UID: \"3f167065-ce40-4e17-aaa1-ca5e9ff01c18\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"
Jul 16 21:44:41.475781 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.475630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f167065-ce40-4e17-aaa1-ca5e9ff01c18-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-brhs2\" (UID: \"3f167065-ce40-4e17-aaa1-ca5e9ff01c18\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"
Jul 16 21:44:41.475781 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.475689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sk9z\" (UniqueName: \"kubernetes.io/projected/5cf7b1da-f6a8-4fec-b894-27ab267e3c24-kube-api-access-7sk9z\") pod \"kserve-controller-manager-d6f4b65b8-qfzb2\" (UID: \"5cf7b1da-f6a8-4fec-b894-27ab267e3c24\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:44:41.475781 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.475727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cf7b1da-f6a8-4fec-b894-27ab267e3c24-cert\") pod \"kserve-controller-manager-d6f4b65b8-qfzb2\" (UID: \"5cf7b1da-f6a8-4fec-b894-27ab267e3c24\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:44:41.475982 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:44:41.475845    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 16 21:44:41.475982 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:44:41.475905    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cf7b1da-f6a8-4fec-b894-27ab267e3c24-cert podName:5cf7b1da-f6a8-4fec-b894-27ab267e3c24 nodeName:}" failed. No retries permitted until 2026-07-16 21:44:41.975884214 +0000 UTC m=+346.801529504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cf7b1da-f6a8-4fec-b894-27ab267e3c24-cert") pod "kserve-controller-manager-d6f4b65b8-qfzb2" (UID: "5cf7b1da-f6a8-4fec-b894-27ab267e3c24") : secret "kserve-webhook-server-cert" not found
Jul 16 21:44:41.479037 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.478987    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3f167065-ce40-4e17-aaa1-ca5e9ff01c18-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-brhs2\" (UID: \"3f167065-ce40-4e17-aaa1-ca5e9ff01c18\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"
Jul 16 21:44:41.510212 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.509544    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sk9z\" (UniqueName: \"kubernetes.io/projected/5cf7b1da-f6a8-4fec-b894-27ab267e3c24-kube-api-access-7sk9z\") pod \"kserve-controller-manager-d6f4b65b8-qfzb2\" (UID: \"5cf7b1da-f6a8-4fec-b894-27ab267e3c24\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:44:41.518223 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.512537    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrpkc\" (UniqueName: \"kubernetes.io/projected/3f167065-ce40-4e17-aaa1-ca5e9ff01c18-kube-api-access-jrpkc\") pod \"llmisvc-controller-manager-777c6bd7d5-brhs2\" (UID: \"3f167065-ce40-4e17-aaa1-ca5e9ff01c18\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"
Jul 16 21:44:41.583798 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.583693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"
Jul 16 21:44:41.765480 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.765449    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"]
Jul 16 21:44:41.766726 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:44:41.766699    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3f167065_ce40_4e17_aaa1_ca5e9ff01c18.slice/crio-ef9ca1326f4196dcee1369d818b518a34b31ad3069f9494112a297de2b9c1aed WatchSource:0}: Error finding container ef9ca1326f4196dcee1369d818b518a34b31ad3069f9494112a297de2b9c1aed: Status 404 returned error can't find the container with id ef9ca1326f4196dcee1369d818b518a34b31ad3069f9494112a297de2b9c1aed
Jul 16 21:44:41.981629 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.981597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cf7b1da-f6a8-4fec-b894-27ab267e3c24-cert\") pod \"kserve-controller-manager-d6f4b65b8-qfzb2\" (UID: \"5cf7b1da-f6a8-4fec-b894-27ab267e3c24\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:44:41.984647 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:41.984621    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cf7b1da-f6a8-4fec-b894-27ab267e3c24-cert\") pod \"kserve-controller-manager-d6f4b65b8-qfzb2\" (UID: \"5cf7b1da-f6a8-4fec-b894-27ab267e3c24\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:44:42.062596 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:42.062561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2" event={"ID":"3f167065-ce40-4e17-aaa1-ca5e9ff01c18","Type":"ContainerStarted","Data":"ef9ca1326f4196dcee1369d818b518a34b31ad3069f9494112a297de2b9c1aed"}
Jul 16 21:44:42.174896 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:42.174854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:44:43.069293 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.069260    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:44:43.069598 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.069335    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:44:43.069598 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.069370    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:44:43.165727 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.165690    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"]
Jul 16 21:44:43.168724 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:44:43.168696    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf7b1da_f6a8_4fec_b894_27ab267e3c24.slice/crio-e4fbf6ac744a8dd9355d512cc0c61809cbda0764f802e15cbb18bcb54d66136e WatchSource:0}: Error finding container e4fbf6ac744a8dd9355d512cc0c61809cbda0764f802e15cbb18bcb54d66136e: Status 404 returned error can't find the container with id e4fbf6ac744a8dd9355d512cc0c61809cbda0764f802e15cbb18bcb54d66136e
Jul 16 21:44:43.354015 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.353862    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"]
Jul 16 21:44:43.354182 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.354157    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc" podUID="2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" containerName="discovery" containerID="cri-o://0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15" gracePeriod=30
Jul 16 21:44:43.721307 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.721276    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:43.797451 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.797421    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-ca-configmap\") pod \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") "
Jul 16 21:44:43.797609 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.797485    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-local-certs\") pod \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") "
Jul 16 21:44:43.797609 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.797511    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-dns-cert\") pod \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") "
Jul 16 21:44:43.797609 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.797545    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-token\") pod \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") "
Jul 16 21:44:43.797609 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.797578    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-cacerts\") pod \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") "
Jul 16 21:44:43.797814 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.797652    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jnt6\" (UniqueName: \"kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-kube-api-access-8jnt6\") pod \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") "
Jul 16 21:44:43.797814 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.797677    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-kubeconfig\") pod \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\" (UID: \"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da\") "
Jul 16 21:44:43.798522 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.798070    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" (UID: "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 21:44:43.801148 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.801117    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" (UID: "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:44:43.801744 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.801717    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-cacerts" (OuterVolumeSpecName: "cacerts") pod "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" (UID: "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:44:43.801850 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.801807    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-token" (OuterVolumeSpecName: "istio-token") pod "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" (UID: "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:44:43.802065 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.802037    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-kube-api-access-8jnt6" (OuterVolumeSpecName: "kube-api-access-8jnt6") pod "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" (UID: "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da"). InnerVolumeSpecName "kube-api-access-8jnt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:44:43.802381 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.802350    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" (UID: "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 21:44:43.803081 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.802921    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-local-certs" (OuterVolumeSpecName: "local-certs") pod "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" (UID: "2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:44:43.898882 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.898841    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:44:43.898882 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.898878    2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-cacerts\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:44:43.898882 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.898890    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jnt6\" (UniqueName: \"kubernetes.io/projected/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-kube-api-access-8jnt6\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:44:43.899155 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.898903    2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-kubeconfig\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:44:43.899155 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.898915    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-ca-configmap\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:44:43.899155 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.898926    2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-local-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:44:43.899155 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:43.898953    2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da-istio-csr-dns-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:44:44.077798 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.077737    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq" event={"ID":"6f08a02d-b6d3-4c9c-a39a-e329bec72562","Type":"ContainerStarted","Data":"4a6fff7c23de6548f3fab70f400d56d7e2feaaa8480863ac7d4f23214439e26b"}
Jul 16 21:44:44.080983 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.080885    2563 generic.go:356] "Generic (PLEG): container finished" podID="2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" containerID="0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15" exitCode=0
Jul 16 21:44:44.081126 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.081066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc" event={"ID":"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da","Type":"ContainerDied","Data":"0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15"}
Jul 16 21:44:44.081126 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.081109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc" event={"ID":"2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da","Type":"ContainerDied","Data":"76d60512069df0bb68e8af0520660771f9c13f677fcc082a9580ad99533c74ea"}
Jul 16 21:44:44.081325 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.081134    2563 scope.go:117] "RemoveContainer" containerID="0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15"
Jul 16 21:44:44.081325 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.081288    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"
Jul 16 21:44:44.086229 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.086185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2" event={"ID":"5cf7b1da-f6a8-4fec-b894-27ab267e3c24","Type":"ContainerStarted","Data":"e4fbf6ac744a8dd9355d512cc0c61809cbda0764f802e15cbb18bcb54d66136e"}
Jul 16 21:44:44.098872 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.097229    2563 scope.go:117] "RemoveContainer" containerID="0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15"
Jul 16 21:44:44.098872 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:44:44.098115    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15\": container with ID starting with 0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15 not found: ID does not exist" containerID="0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15"
Jul 16 21:44:44.098872 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.098152    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15"} err="failed to get container status \"0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15\": rpc error: code = NotFound desc = could not find container \"0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15\": container with ID starting with 0367f28bbac1b04457bd407e1780d29c047f7b5d59caa84e99a4c1bdfc5a0e15 not found: ID does not exist"
Jul 16 21:44:44.138160 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.138103    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq" podStartSLOduration=2.178954121 podStartE2EDuration="5.138084552s" totalImagesPullingTime="2.959130431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:44:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:44:44.112957611 +0000 UTC m=+348.938602906" watchObservedRunningTime="2026-07-16 21:44:44.138084552 +0000 UTC m=+348.963729851"
Jul 16 21:44:44.140414 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.140387    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"]
Jul 16 21:44:44.150023 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.149980    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nz5nc"]
Jul 16 21:44:44.922126 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.922094    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:44.928051 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:44.928023    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:45.092625 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:45.092594    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:45.093856 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:45.093834    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4hcplq"
Jul 16 21:44:45.678309 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:45.678278    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" path="/var/lib/kubelet/pods/2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da/volumes"
Jul 16 21:44:46.030722 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:46.030686    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-kgf9p"
Jul 16 21:44:47.102211 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:47.102125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2" event={"ID":"3f167065-ce40-4e17-aaa1-ca5e9ff01c18","Type":"ContainerStarted","Data":"96052e854b207c19192d0dab2aa21d48da78b6d886399712c7dbae765497d7f7"}
Jul 16 21:44:47.102621 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:47.102240    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"
Jul 16 21:44:47.103640 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:47.103612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2" event={"ID":"5cf7b1da-f6a8-4fec-b894-27ab267e3c24","Type":"ContainerStarted","Data":"99155086e4a4ed4eec11047d6985d1a2739836202080ac0067a61ad0d3995275"}
Jul 16 21:44:47.103890 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:47.103875    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:44:47.121727 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:47.121687    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2" podStartSLOduration=1.753941904 podStartE2EDuration="6.12167464s" totalImagesPullingTime="4.367732736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:44:47.119059703 +0000 UTC m=+351.944705002" watchObservedRunningTime="2026-07-16 21:44:47.12167464 +0000 UTC m=+351.947319989"
Jul 16 21:44:48.043558 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:48.043529    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-6kzw6"
Jul 16 21:44:48.064286 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:44:48.064241    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2" podStartSLOduration=4.101460103 podStartE2EDuration="7.064225358s" totalImagesPullingTime="2.962765255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:44:47.146638724 +0000 UTC m=+351.972284026" watchObservedRunningTime="2026-07-16 21:44:48.064225358 +0000 UTC m=+352.889870659"
Jul 16 21:45:18.111139 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:18.111108    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-brhs2"
Jul 16 21:45:18.114323 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:18.114301    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-qfzb2"
Jul 16 21:45:30.414992 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.414959    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kw44x"]
Jul 16 21:45:30.415422 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.415241    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" containerName="discovery"
Jul 16 21:45:30.415422 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.415252    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" containerName="discovery"
Jul 16 21:45:30.415422 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.415315    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bf150f9-ad1b-4b23-a3f3-e4bc69a7d5da" containerName="discovery"
Jul 16 21:45:30.418780 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.418763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kw44x"
Jul 16 21:45:30.428008 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.427989    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wt7v9\""
Jul 16 21:45:30.428811 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.428797    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 21:45:30.428859 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.428817    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 21:45:30.439122 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.439098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kw44x"]
Jul 16 21:45:30.461050 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.461027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p9s7\" (UniqueName: \"kubernetes.io/projected/48d59631-a2b0-41f6-a0eb-013c05f0ab35-kube-api-access-6p9s7\") pod \"kuadrant-operator-catalog-kw44x\" (UID: \"48d59631-a2b0-41f6-a0eb-013c05f0ab35\") " pod="kuadrant-system/kuadrant-operator-catalog-kw44x"
Jul 16 21:45:30.561563 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.561513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p9s7\" (UniqueName: \"kubernetes.io/projected/48d59631-a2b0-41f6-a0eb-013c05f0ab35-kube-api-access-6p9s7\") pod \"kuadrant-operator-catalog-kw44x\" (UID: \"48d59631-a2b0-41f6-a0eb-013c05f0ab35\") " pod="kuadrant-system/kuadrant-operator-catalog-kw44x"
Jul 16 21:45:30.569992 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.569967    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p9s7\" (UniqueName: \"kubernetes.io/projected/48d59631-a2b0-41f6-a0eb-013c05f0ab35-kube-api-access-6p9s7\") pod \"kuadrant-operator-catalog-kw44x\" (UID: \"48d59631-a2b0-41f6-a0eb-013c05f0ab35\") " pod="kuadrant-system/kuadrant-operator-catalog-kw44x"
Jul 16 21:45:30.728595 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.728567    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kw44x"
Jul 16 21:45:30.763174 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.763140    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kw44x"]
Jul 16 21:45:30.861821 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.861786    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kw44x"]
Jul 16 21:45:30.864745 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:45:30.864714    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d59631_a2b0_41f6_a0eb_013c05f0ab35.slice/crio-faee5fa3b7fd9cbb8ee745e8344fd64cde0af1b94df2f062fc6a09d445fd7df3 WatchSource:0}: Error finding container faee5fa3b7fd9cbb8ee745e8344fd64cde0af1b94df2f062fc6a09d445fd7df3: Status 404 returned error can't find the container with id faee5fa3b7fd9cbb8ee745e8344fd64cde0af1b94df2f062fc6a09d445fd7df3
Jul 16 21:45:30.974313 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.974287    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pqkcn"]
Jul 16 21:45:30.977081 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.977065    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pqkcn"
Jul 16 21:45:30.986276 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:30.986255    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pqkcn"]
Jul 16 21:45:31.066300 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:31.066270    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6qjn\" (UniqueName: \"kubernetes.io/projected/c20e4ae6-0e5f-4089-af28-9629f7fe07f3-kube-api-access-d6qjn\") pod \"kuadrant-operator-catalog-pqkcn\" (UID: \"c20e4ae6-0e5f-4089-af28-9629f7fe07f3\") " pod="kuadrant-system/kuadrant-operator-catalog-pqkcn"
Jul 16 21:45:31.167397 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:31.167366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6qjn\" (UniqueName: \"kubernetes.io/projected/c20e4ae6-0e5f-4089-af28-9629f7fe07f3-kube-api-access-d6qjn\") pod \"kuadrant-operator-catalog-pqkcn\" (UID: \"c20e4ae6-0e5f-4089-af28-9629f7fe07f3\") " pod="kuadrant-system/kuadrant-operator-catalog-pqkcn"
Jul 16 21:45:31.176413 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:31.176392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6qjn\" (UniqueName: \"kubernetes.io/projected/c20e4ae6-0e5f-4089-af28-9629f7fe07f3-kube-api-access-d6qjn\") pod \"kuadrant-operator-catalog-pqkcn\" (UID: \"c20e4ae6-0e5f-4089-af28-9629f7fe07f3\") " pod="kuadrant-system/kuadrant-operator-catalog-pqkcn"
Jul 16 21:45:31.287068 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:31.286994    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-pqkcn"
Jul 16 21:45:31.291387 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:31.291364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kw44x" event={"ID":"48d59631-a2b0-41f6-a0eb-013c05f0ab35","Type":"ContainerStarted","Data":"faee5fa3b7fd9cbb8ee745e8344fd64cde0af1b94df2f062fc6a09d445fd7df3"}
Jul 16 21:45:31.414319 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:31.414294    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-pqkcn"]
Jul 16 21:45:31.416072 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:45:31.416043    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20e4ae6_0e5f_4089_af28_9629f7fe07f3.slice/crio-dac6667100045ca33e19a6747b55b2fe1eab2c4f240afaa0a562643d28c87371 WatchSource:0}: Error finding container dac6667100045ca33e19a6747b55b2fe1eab2c4f240afaa0a562643d28c87371: Status 404 returned error can't find the container with id dac6667100045ca33e19a6747b55b2fe1eab2c4f240afaa0a562643d28c87371
Jul 16 21:45:32.299710 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:32.299674    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pqkcn" event={"ID":"c20e4ae6-0e5f-4089-af28-9629f7fe07f3","Type":"ContainerStarted","Data":"dac6667100045ca33e19a6747b55b2fe1eab2c4f240afaa0a562643d28c87371"}
Jul 16 21:45:33.305364 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:33.305329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kw44x" event={"ID":"48d59631-a2b0-41f6-a0eb-013c05f0ab35","Type":"ContainerStarted","Data":"fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460"}
Jul 16 21:45:33.305810 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:33.305442    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kw44x" podUID="48d59631-a2b0-41f6-a0eb-013c05f0ab35" containerName="registry-server" containerID="cri-o://fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460" gracePeriod=2
Jul 16 21:45:33.306991 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:33.306963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-pqkcn" event={"ID":"c20e4ae6-0e5f-4089-af28-9629f7fe07f3","Type":"ContainerStarted","Data":"b1bf9595e0ca6b78c1abd49a7c204b3330465f4c3305596cd481a38d5475e500"}
Jul 16 21:45:33.355900 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:33.355860    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-pqkcn" podStartSLOduration=1.967102978 podStartE2EDuration="3.355847758s" totalImagesPullingTime="1.38874478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:45:33.355555139 +0000 UTC m=+398.181200439" watchObservedRunningTime="2026-07-16 21:45:33.355847758 +0000 UTC m=+398.181493057"
Jul 16 21:45:33.357048 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:33.356998    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kw44x" podStartSLOduration=1.415337568 podStartE2EDuration="3.356986048s" totalImagesPullingTime="1.94164848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:45:33.330820557 +0000 UTC m=+398.156465856" watchObservedRunningTime="2026-07-16 21:45:33.356986048 +0000 UTC m=+398.182631347"
Jul 16 21:45:33.549374 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:33.549352    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kw44x"
Jul 16 21:45:33.587391 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:33.587324    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p9s7\" (UniqueName: \"kubernetes.io/projected/48d59631-a2b0-41f6-a0eb-013c05f0ab35-kube-api-access-6p9s7\") pod \"48d59631-a2b0-41f6-a0eb-013c05f0ab35\" (UID: \"48d59631-a2b0-41f6-a0eb-013c05f0ab35\") "
Jul 16 21:45:33.589511 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:33.589490    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48d59631-a2b0-41f6-a0eb-013c05f0ab35-kube-api-access-6p9s7" (OuterVolumeSpecName: "kube-api-access-6p9s7") pod "48d59631-a2b0-41f6-a0eb-013c05f0ab35" (UID: "48d59631-a2b0-41f6-a0eb-013c05f0ab35"). InnerVolumeSpecName "kube-api-access-6p9s7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:45:33.688573 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:33.688551    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p9s7\" (UniqueName: \"kubernetes.io/projected/48d59631-a2b0-41f6-a0eb-013c05f0ab35-kube-api-access-6p9s7\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:34.312832 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:34.312802    2563 generic.go:356] "Generic (PLEG): container finished" podID="48d59631-a2b0-41f6-a0eb-013c05f0ab35" containerID="fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460" exitCode=0
Jul 16 21:45:34.313244 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:34.312851    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kw44x"
Jul 16 21:45:34.313244 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:34.312886    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kw44x" event={"ID":"48d59631-a2b0-41f6-a0eb-013c05f0ab35","Type":"ContainerDied","Data":"fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460"}
Jul 16 21:45:34.313244 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:34.312934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kw44x" event={"ID":"48d59631-a2b0-41f6-a0eb-013c05f0ab35","Type":"ContainerDied","Data":"faee5fa3b7fd9cbb8ee745e8344fd64cde0af1b94df2f062fc6a09d445fd7df3"}
Jul 16 21:45:34.313244 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:34.312977    2563 scope.go:117] "RemoveContainer" containerID="fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460"
Jul 16 21:45:34.321584 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:34.321567    2563 scope.go:117] "RemoveContainer" containerID="fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460"
Jul 16 21:45:34.321835 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:45:34.321818    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460\": container with ID starting with fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460 not found: ID does not exist" containerID="fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460"
Jul 16 21:45:34.321893 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:34.321843    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460"} err="failed to get container status \"fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460\": rpc error: code = NotFound desc = could not find container \"fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460\": container with ID starting with fa5d6bcb91edb757d1fc1151633b7344e03c295a525d17a074fc6d8135f7a460 not found: ID does not exist"
Jul 16 21:45:34.328892 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:34.328871    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kw44x"]
Jul 16 21:45:34.333210 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:34.333190    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kw44x"]
Jul 16 21:45:35.673742 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:35.673708    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48d59631-a2b0-41f6-a0eb-013c05f0ab35" path="/var/lib/kubelet/pods/48d59631-a2b0-41f6-a0eb-013c05f0ab35/volumes"
Jul 16 21:45:41.287190 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:41.287134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-pqkcn"
Jul 16 21:45:41.287635 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:41.287216    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-pqkcn"
Jul 16 21:45:41.309577 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:41.309550    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-pqkcn"
Jul 16 21:45:41.366406 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:41.366375    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-pqkcn"
Jul 16 21:45:45.571832 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.571797    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"]
Jul 16 21:45:45.572241 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.572132    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48d59631-a2b0-41f6-a0eb-013c05f0ab35" containerName="registry-server"
Jul 16 21:45:45.572241 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.572147    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="48d59631-a2b0-41f6-a0eb-013c05f0ab35" containerName="registry-server"
Jul 16 21:45:45.572241 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.572206    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="48d59631-a2b0-41f6-a0eb-013c05f0ab35" containerName="registry-server"
Jul 16 21:45:45.576586 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.576558    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:45.579423 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.579404    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mq8xk\""
Jul 16 21:45:45.585149 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.585128    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"]
Jul 16 21:45:45.686981 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.686933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:45.687175 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.687056    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:45.687175 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.687081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kztp\" (UniqueName: \"kubernetes.io/projected/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-kube-api-access-4kztp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:45.787838 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.787805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:45.788026 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.787844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kztp\" (UniqueName: \"kubernetes.io/projected/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-kube-api-access-4kztp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:45.788026 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.787879    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:45.788296 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.788271    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:45.788359 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.788298    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:45.796992 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.796961    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kztp\" (UniqueName: \"kubernetes.io/projected/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-kube-api-access-4kztp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:45.886333 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:45.886273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:46.014344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.014323    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"]
Jul 16 21:45:46.016843 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:45:46.016818    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6ace45_a35b_440a_8e0c_6e8c28b6782e.slice/crio-ae02a477f59fafbb452b6392404606e39bd4b8adabee19654e7b13c378f0fb40 WatchSource:0}: Error finding container ae02a477f59fafbb452b6392404606e39bd4b8adabee19654e7b13c378f0fb40: Status 404 returned error can't find the container with id ae02a477f59fafbb452b6392404606e39bd4b8adabee19654e7b13c378f0fb40
Jul 16 21:45:46.363843 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.363810    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"]
Jul 16 21:45:46.367244 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.367219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.367516 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.367495    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e6ace45-a35b-440a-8e0c-6e8c28b6782e" containerID="efc8f968dd1ed629bb0c87f7036475afe6a5c60ca412e4c8389f83e437dee94f" exitCode=0
Jul 16 21:45:46.367581 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.367520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2" event={"ID":"4e6ace45-a35b-440a-8e0c-6e8c28b6782e","Type":"ContainerDied","Data":"efc8f968dd1ed629bb0c87f7036475afe6a5c60ca412e4c8389f83e437dee94f"}
Jul 16 21:45:46.367581 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.367556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2" event={"ID":"4e6ace45-a35b-440a-8e0c-6e8c28b6782e","Type":"ContainerStarted","Data":"ae02a477f59fafbb452b6392404606e39bd4b8adabee19654e7b13c378f0fb40"}
Jul 16 21:45:46.375871 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.375850    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"]
Jul 16 21:45:46.493517 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.493476    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7pqn\" (UniqueName: \"kubernetes.io/projected/849ade00-3944-418e-a2af-fcf8cc402926-kube-api-access-p7pqn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.493668 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.493537    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.493668 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.493590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.594949 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.594912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pqn\" (UniqueName: \"kubernetes.io/projected/849ade00-3944-418e-a2af-fcf8cc402926-kube-api-access-p7pqn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.595305 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.594987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.595305 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.595018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.595385 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.595365    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.595423 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.595389    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.604040 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.604023    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7pqn\" (UniqueName: \"kubernetes.io/projected/849ade00-3944-418e-a2af-fcf8cc402926-kube-api-access-p7pqn\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.677258 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.677169    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:46.805259 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.805231    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"]
Jul 16 21:45:46.807249 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:45:46.807222    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849ade00_3944_418e_a2af_fcf8cc402926.slice/crio-9487cda816f0c6125ca1ac1a950c5770e191151abeeeca623b4170feb282cb43 WatchSource:0}: Error finding container 9487cda816f0c6125ca1ac1a950c5770e191151abeeeca623b4170feb282cb43: Status 404 returned error can't find the container with id 9487cda816f0c6125ca1ac1a950c5770e191151abeeeca623b4170feb282cb43
Jul 16 21:45:46.965025 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.964991    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"]
Jul 16 21:45:46.968202 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.968184    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:46.977062 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:46.977037    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"]
Jul 16 21:45:47.098144 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.098103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcfsx\" (UniqueName: \"kubernetes.io/projected/1d10626c-cc9c-4d10-a10e-b5eb0a913903-kube-api-access-lcfsx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:47.098144 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.098150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:47.098360 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.098190    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:47.199590 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.199559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcfsx\" (UniqueName: \"kubernetes.io/projected/1d10626c-cc9c-4d10-a10e-b5eb0a913903-kube-api-access-lcfsx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:47.199590 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.199591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:47.199774 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.199615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:47.200038 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.200017    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:47.200081 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.200027    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:47.209396 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.209374    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcfsx\" (UniqueName: \"kubernetes.io/projected/1d10626c-cc9c-4d10-a10e-b5eb0a913903-kube-api-access-lcfsx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:47.277587 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.277515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:47.367010 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.366979    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"]
Jul 16 21:45:47.370664 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.370642    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.378375 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.378348    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"]
Jul 16 21:45:47.378583 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.378543    2563 generic.go:356] "Generic (PLEG): container finished" podID="849ade00-3944-418e-a2af-fcf8cc402926" containerID="89f6bf2316d67b1d9b4ce6b66b8f7fb312a0ffafed362e15ee01400bb13333b2" exitCode=0
Jul 16 21:45:47.378691 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.378672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w" event={"ID":"849ade00-3944-418e-a2af-fcf8cc402926","Type":"ContainerDied","Data":"89f6bf2316d67b1d9b4ce6b66b8f7fb312a0ffafed362e15ee01400bb13333b2"}
Jul 16 21:45:47.378771 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.378718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w" event={"ID":"849ade00-3944-418e-a2af-fcf8cc402926","Type":"ContainerStarted","Data":"9487cda816f0c6125ca1ac1a950c5770e191151abeeeca623b4170feb282cb43"}
Jul 16 21:45:47.422004 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.421984    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"]
Jul 16 21:45:47.424885 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:45:47.424854    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d10626c_cc9c_4d10_a10e_b5eb0a913903.slice/crio-de3057ea4fbcc721fbdaa9d00caee8bda77c84216a5483dde948ab5037b34feb WatchSource:0}: Error finding container de3057ea4fbcc721fbdaa9d00caee8bda77c84216a5483dde948ab5037b34feb: Status 404 returned error can't find the container with id de3057ea4fbcc721fbdaa9d00caee8bda77c84216a5483dde948ab5037b34feb
Jul 16 21:45:47.502466 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.502439    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76fm8\" (UniqueName: \"kubernetes.io/projected/494b5a83-79e7-4225-a5de-35d7b6e60e63-kube-api-access-76fm8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.502607 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.502498    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.502607 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.502540    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.603912 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.603846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76fm8\" (UniqueName: \"kubernetes.io/projected/494b5a83-79e7-4225-a5de-35d7b6e60e63-kube-api-access-76fm8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.603912 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.603889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.604306 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.603924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.604344 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.604312    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.604376 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.604353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.612635 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.612613    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76fm8\" (UniqueName: \"kubernetes.io/projected/494b5a83-79e7-4225-a5de-35d7b6e60e63-kube-api-access-76fm8\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.683834 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.683810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:47.815403 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:47.815383    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"]
Jul 16 21:45:47.817482 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:45:47.817459    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod494b5a83_79e7_4225_a5de_35d7b6e60e63.slice/crio-81b1e59f6066f6862f917867835acd369c00f101dfd12b7808721adde8b4044f WatchSource:0}: Error finding container 81b1e59f6066f6862f917867835acd369c00f101dfd12b7808721adde8b4044f: Status 404 returned error can't find the container with id 81b1e59f6066f6862f917867835acd369c00f101dfd12b7808721adde8b4044f
Jul 16 21:45:48.385040 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:48.385006    2563 generic.go:356] "Generic (PLEG): container finished" podID="494b5a83-79e7-4225-a5de-35d7b6e60e63" containerID="2ba4274191c1447d6a14d64f8e2c67d8a67994f733ebc89a47570da39629ee16" exitCode=0
Jul 16 21:45:48.385259 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:48.385096    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq" event={"ID":"494b5a83-79e7-4225-a5de-35d7b6e60e63","Type":"ContainerDied","Data":"2ba4274191c1447d6a14d64f8e2c67d8a67994f733ebc89a47570da39629ee16"}
Jul 16 21:45:48.385259 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:48.385148    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq" event={"ID":"494b5a83-79e7-4225-a5de-35d7b6e60e63","Type":"ContainerStarted","Data":"81b1e59f6066f6862f917867835acd369c00f101dfd12b7808721adde8b4044f"}
Jul 16 21:45:48.387062 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:48.387035    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e6ace45-a35b-440a-8e0c-6e8c28b6782e" containerID="458a68bdb893f5f0a55af0f4ebb1832b8df053b7b9fd8759d8c78a4ad9c1b5a1" exitCode=0
Jul 16 21:45:48.387183 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:48.387104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2" event={"ID":"4e6ace45-a35b-440a-8e0c-6e8c28b6782e","Type":"ContainerDied","Data":"458a68bdb893f5f0a55af0f4ebb1832b8df053b7b9fd8759d8c78a4ad9c1b5a1"}
Jul 16 21:45:48.388799 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:48.388774    2563 generic.go:356] "Generic (PLEG): container finished" podID="1d10626c-cc9c-4d10-a10e-b5eb0a913903" containerID="599bce17f74e358e8e69de40d4e511ecd80efdbbcc309c6b53bd935f82b25f7d" exitCode=0
Jul 16 21:45:48.388904 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:48.388857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx" event={"ID":"1d10626c-cc9c-4d10-a10e-b5eb0a913903","Type":"ContainerDied","Data":"599bce17f74e358e8e69de40d4e511ecd80efdbbcc309c6b53bd935f82b25f7d"}
Jul 16 21:45:48.388904 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:48.388897    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx" event={"ID":"1d10626c-cc9c-4d10-a10e-b5eb0a913903","Type":"ContainerStarted","Data":"de3057ea4fbcc721fbdaa9d00caee8bda77c84216a5483dde948ab5037b34feb"}
Jul 16 21:45:49.396021 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:49.395986    2563 generic.go:356] "Generic (PLEG): container finished" podID="4e6ace45-a35b-440a-8e0c-6e8c28b6782e" containerID="c7bea9486bdf4c3000ccd11261d3aaaef27eb6d2243bdda1a48f33bc8839ea1c" exitCode=0
Jul 16 21:45:49.396432 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:49.396074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2" event={"ID":"4e6ace45-a35b-440a-8e0c-6e8c28b6782e","Type":"ContainerDied","Data":"c7bea9486bdf4c3000ccd11261d3aaaef27eb6d2243bdda1a48f33bc8839ea1c"}
Jul 16 21:45:49.397890 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:49.397857    2563 generic.go:356] "Generic (PLEG): container finished" podID="1d10626c-cc9c-4d10-a10e-b5eb0a913903" containerID="15a1bdcd015f424f83e4dd340492095a8987b4130f6ee59819bc8fc74ab740b5" exitCode=0
Jul 16 21:45:49.398019 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:49.397930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx" event={"ID":"1d10626c-cc9c-4d10-a10e-b5eb0a913903","Type":"ContainerDied","Data":"15a1bdcd015f424f83e4dd340492095a8987b4130f6ee59819bc8fc74ab740b5"}
Jul 16 21:45:50.404821 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.404788    2563 generic.go:356] "Generic (PLEG): container finished" podID="1d10626c-cc9c-4d10-a10e-b5eb0a913903" containerID="0cf41db0db72b5b8cca51a8d68dcb9584c4c732731e779f1b0c1b952dbf4bc29" exitCode=0
Jul 16 21:45:50.405163 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.404868    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx" event={"ID":"1d10626c-cc9c-4d10-a10e-b5eb0a913903","Type":"ContainerDied","Data":"0cf41db0db72b5b8cca51a8d68dcb9584c4c732731e779f1b0c1b952dbf4bc29"}
Jul 16 21:45:50.406502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.406482    2563 generic.go:356] "Generic (PLEG): container finished" podID="849ade00-3944-418e-a2af-fcf8cc402926" containerID="f56f608a44814aa18d89a0acc5fc7c23db1103b8b6d54dbe41cbc503cdf9919e" exitCode=0
Jul 16 21:45:50.406597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.406540    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w" event={"ID":"849ade00-3944-418e-a2af-fcf8cc402926","Type":"ContainerDied","Data":"f56f608a44814aa18d89a0acc5fc7c23db1103b8b6d54dbe41cbc503cdf9919e"}
Jul 16 21:45:50.608676 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.608651    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:50.731352 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.731311    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kztp\" (UniqueName: \"kubernetes.io/projected/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-kube-api-access-4kztp\") pod \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") "
Jul 16 21:45:50.731560 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.731411    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-bundle\") pod \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") "
Jul 16 21:45:50.731560 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.731457    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-util\") pod \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\" (UID: \"4e6ace45-a35b-440a-8e0c-6e8c28b6782e\") "
Jul 16 21:45:50.731891 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.731864    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-bundle" (OuterVolumeSpecName: "bundle") pod "4e6ace45-a35b-440a-8e0c-6e8c28b6782e" (UID: "4e6ace45-a35b-440a-8e0c-6e8c28b6782e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:45:50.733615 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.733596    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-kube-api-access-4kztp" (OuterVolumeSpecName: "kube-api-access-4kztp") pod "4e6ace45-a35b-440a-8e0c-6e8c28b6782e" (UID: "4e6ace45-a35b-440a-8e0c-6e8c28b6782e"). InnerVolumeSpecName "kube-api-access-4kztp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:45:50.736569 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.736535    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-util" (OuterVolumeSpecName: "util") pod "4e6ace45-a35b-440a-8e0c-6e8c28b6782e" (UID: "4e6ace45-a35b-440a-8e0c-6e8c28b6782e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:45:50.832395 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.832348    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kztp\" (UniqueName: \"kubernetes.io/projected/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-kube-api-access-4kztp\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:50.832395 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.832391    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:50.832395 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:50.832400    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e6ace45-a35b-440a-8e0c-6e8c28b6782e-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:51.414233 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.414199    2563 generic.go:356] "Generic (PLEG): container finished" podID="494b5a83-79e7-4225-a5de-35d7b6e60e63" containerID="fd539bcbf5d272874fcd25590da6b64bb658e462117c3f6fc5547d0557224e5e" exitCode=0
Jul 16 21:45:51.414671 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.414283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq" event={"ID":"494b5a83-79e7-4225-a5de-35d7b6e60e63","Type":"ContainerDied","Data":"fd539bcbf5d272874fcd25590da6b64bb658e462117c3f6fc5547d0557224e5e"}
Jul 16 21:45:51.416572 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.416550    2563 generic.go:356] "Generic (PLEG): container finished" podID="849ade00-3944-418e-a2af-fcf8cc402926" containerID="1679bbbd76a7f15028c0d8918e9041b84b0d3e9b23f20e3f3bc4165e195c48ea" exitCode=0
Jul 16 21:45:51.416657 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.416632    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w" event={"ID":"849ade00-3944-418e-a2af-fcf8cc402926","Type":"ContainerDied","Data":"1679bbbd76a7f15028c0d8918e9041b84b0d3e9b23f20e3f3bc4165e195c48ea"}
Jul 16 21:45:51.418568 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.418552    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2"
Jul 16 21:45:51.418649 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.418580    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2" event={"ID":"4e6ace45-a35b-440a-8e0c-6e8c28b6782e","Type":"ContainerDied","Data":"ae02a477f59fafbb452b6392404606e39bd4b8adabee19654e7b13c378f0fb40"}
Jul 16 21:45:51.418649 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.418613    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae02a477f59fafbb452b6392404606e39bd4b8adabee19654e7b13c378f0fb40"
Jul 16 21:45:51.561133 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.561105    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:51.639037 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.639009    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-bundle\") pod \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") "
Jul 16 21:45:51.639214 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.639059    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-util\") pod \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") "
Jul 16 21:45:51.639214 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.639080    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcfsx\" (UniqueName: \"kubernetes.io/projected/1d10626c-cc9c-4d10-a10e-b5eb0a913903-kube-api-access-lcfsx\") pod \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\" (UID: \"1d10626c-cc9c-4d10-a10e-b5eb0a913903\") "
Jul 16 21:45:51.639571 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.639549    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-bundle" (OuterVolumeSpecName: "bundle") pod "1d10626c-cc9c-4d10-a10e-b5eb0a913903" (UID: "1d10626c-cc9c-4d10-a10e-b5eb0a913903"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:45:51.641306 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.641279    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d10626c-cc9c-4d10-a10e-b5eb0a913903-kube-api-access-lcfsx" (OuterVolumeSpecName: "kube-api-access-lcfsx") pod "1d10626c-cc9c-4d10-a10e-b5eb0a913903" (UID: "1d10626c-cc9c-4d10-a10e-b5eb0a913903"). InnerVolumeSpecName "kube-api-access-lcfsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:45:51.644431 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.644412    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-util" (OuterVolumeSpecName: "util") pod "1d10626c-cc9c-4d10-a10e-b5eb0a913903" (UID: "1d10626c-cc9c-4d10-a10e-b5eb0a913903"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:45:51.740598 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.740572    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:51.740729 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.740602    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcfsx\" (UniqueName: \"kubernetes.io/projected/1d10626c-cc9c-4d10-a10e-b5eb0a913903-kube-api-access-lcfsx\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:51.740729 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:51.740617    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d10626c-cc9c-4d10-a10e-b5eb0a913903-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:52.425282 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.425258    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx"
Jul 16 21:45:52.425662 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.425300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx" event={"ID":"1d10626c-cc9c-4d10-a10e-b5eb0a913903","Type":"ContainerDied","Data":"de3057ea4fbcc721fbdaa9d00caee8bda77c84216a5483dde948ab5037b34feb"}
Jul 16 21:45:52.425662 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.425347    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de3057ea4fbcc721fbdaa9d00caee8bda77c84216a5483dde948ab5037b34feb"
Jul 16 21:45:52.427586 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.427560    2563 generic.go:356] "Generic (PLEG): container finished" podID="494b5a83-79e7-4225-a5de-35d7b6e60e63" containerID="b3fdfdae1b6095d0c75637bd428450081503bf98ffb5a4564b65850649ae637f" exitCode=0
Jul 16 21:45:52.427700 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.427637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq" event={"ID":"494b5a83-79e7-4225-a5de-35d7b6e60e63","Type":"ContainerDied","Data":"b3fdfdae1b6095d0c75637bd428450081503bf98ffb5a4564b65850649ae637f"}
Jul 16 21:45:52.556950 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.556915    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:52.647629 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.647597    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-util\") pod \"849ade00-3944-418e-a2af-fcf8cc402926\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") "
Jul 16 21:45:52.647629 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.647631    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-bundle\") pod \"849ade00-3944-418e-a2af-fcf8cc402926\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") "
Jul 16 21:45:52.647834 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.647690    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7pqn\" (UniqueName: \"kubernetes.io/projected/849ade00-3944-418e-a2af-fcf8cc402926-kube-api-access-p7pqn\") pod \"849ade00-3944-418e-a2af-fcf8cc402926\" (UID: \"849ade00-3944-418e-a2af-fcf8cc402926\") "
Jul 16 21:45:52.648132 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.648099    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-bundle" (OuterVolumeSpecName: "bundle") pod "849ade00-3944-418e-a2af-fcf8cc402926" (UID: "849ade00-3944-418e-a2af-fcf8cc402926"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:45:52.649879 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.649860    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/849ade00-3944-418e-a2af-fcf8cc402926-kube-api-access-p7pqn" (OuterVolumeSpecName: "kube-api-access-p7pqn") pod "849ade00-3944-418e-a2af-fcf8cc402926" (UID: "849ade00-3944-418e-a2af-fcf8cc402926"). InnerVolumeSpecName "kube-api-access-p7pqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:45:52.652120 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.652090    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-util" (OuterVolumeSpecName: "util") pod "849ade00-3944-418e-a2af-fcf8cc402926" (UID: "849ade00-3944-418e-a2af-fcf8cc402926"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:45:52.748986 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.748931    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7pqn\" (UniqueName: \"kubernetes.io/projected/849ade00-3944-418e-a2af-fcf8cc402926-kube-api-access-p7pqn\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:52.748986 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.748987    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:52.749138 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:52.748997    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/849ade00-3944-418e-a2af-fcf8cc402926-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:53.434667 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.434627    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w"
Jul 16 21:45:53.434667 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.434639    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w" event={"ID":"849ade00-3944-418e-a2af-fcf8cc402926","Type":"ContainerDied","Data":"9487cda816f0c6125ca1ac1a950c5770e191151abeeeca623b4170feb282cb43"}
Jul 16 21:45:53.435109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.434681    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9487cda816f0c6125ca1ac1a950c5770e191151abeeeca623b4170feb282cb43"
Jul 16 21:45:53.579081 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.579061    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:53.656153 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.656124    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76fm8\" (UniqueName: \"kubernetes.io/projected/494b5a83-79e7-4225-a5de-35d7b6e60e63-kube-api-access-76fm8\") pod \"494b5a83-79e7-4225-a5de-35d7b6e60e63\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") "
Jul 16 21:45:53.656285 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.656159    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-util\") pod \"494b5a83-79e7-4225-a5de-35d7b6e60e63\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") "
Jul 16 21:45:53.656285 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.656200    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-bundle\") pod \"494b5a83-79e7-4225-a5de-35d7b6e60e63\" (UID: \"494b5a83-79e7-4225-a5de-35d7b6e60e63\") "
Jul 16 21:45:53.656849 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.656761    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-bundle" (OuterVolumeSpecName: "bundle") pod "494b5a83-79e7-4225-a5de-35d7b6e60e63" (UID: "494b5a83-79e7-4225-a5de-35d7b6e60e63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:45:53.658272 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.658245    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/494b5a83-79e7-4225-a5de-35d7b6e60e63-kube-api-access-76fm8" (OuterVolumeSpecName: "kube-api-access-76fm8") pod "494b5a83-79e7-4225-a5de-35d7b6e60e63" (UID: "494b5a83-79e7-4225-a5de-35d7b6e60e63"). InnerVolumeSpecName "kube-api-access-76fm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:45:53.660525 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.660507    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-util" (OuterVolumeSpecName: "util") pod "494b5a83-79e7-4225-a5de-35d7b6e60e63" (UID: "494b5a83-79e7-4225-a5de-35d7b6e60e63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:45:53.757062 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.757001    2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-bundle\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:53.757062 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.757025    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76fm8\" (UniqueName: \"kubernetes.io/projected/494b5a83-79e7-4225-a5de-35d7b6e60e63-kube-api-access-76fm8\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:53.757062 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:53.757046    2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/494b5a83-79e7-4225-a5de-35d7b6e60e63-util\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:45:54.440907 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:54.440872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq" event={"ID":"494b5a83-79e7-4225-a5de-35d7b6e60e63","Type":"ContainerDied","Data":"81b1e59f6066f6862f917867835acd369c00f101dfd12b7808721adde8b4044f"}
Jul 16 21:45:54.440907 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:54.440899    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq"
Jul 16 21:45:54.441337 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:45:54.440919    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81b1e59f6066f6862f917867835acd369c00f101dfd12b7808721adde8b4044f"
Jul 16 21:46:02.812548 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812515    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-snmhq"]
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812806    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e6ace45-a35b-440a-8e0c-6e8c28b6782e" containerName="pull"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812816    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6ace45-a35b-440a-8e0c-6e8c28b6782e" containerName="pull"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812828    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d10626c-cc9c-4d10-a10e-b5eb0a913903" containerName="extract"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812833    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d10626c-cc9c-4d10-a10e-b5eb0a913903" containerName="extract"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812841    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d10626c-cc9c-4d10-a10e-b5eb0a913903" containerName="util"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812848    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d10626c-cc9c-4d10-a10e-b5eb0a913903" containerName="util"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812855    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="849ade00-3944-418e-a2af-fcf8cc402926" containerName="util"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812859    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="849ade00-3944-418e-a2af-fcf8cc402926" containerName="util"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812864    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="849ade00-3944-418e-a2af-fcf8cc402926" containerName="extract"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812869    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="849ade00-3944-418e-a2af-fcf8cc402926" containerName="extract"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812876    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="494b5a83-79e7-4225-a5de-35d7b6e60e63" containerName="util"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812882    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="494b5a83-79e7-4225-a5de-35d7b6e60e63" containerName="util"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812887    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="494b5a83-79e7-4225-a5de-35d7b6e60e63" containerName="extract"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812892    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="494b5a83-79e7-4225-a5de-35d7b6e60e63" containerName="extract"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812901    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e6ace45-a35b-440a-8e0c-6e8c28b6782e" containerName="util"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812906    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6ace45-a35b-440a-8e0c-6e8c28b6782e" containerName="util"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812915    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="494b5a83-79e7-4225-a5de-35d7b6e60e63" containerName="pull"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812919    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="494b5a83-79e7-4225-a5de-35d7b6e60e63" containerName="pull"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812925    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="849ade00-3944-418e-a2af-fcf8cc402926" containerName="pull"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812929    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="849ade00-3944-418e-a2af-fcf8cc402926" containerName="pull"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812953    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e6ace45-a35b-440a-8e0c-6e8c28b6782e" containerName="extract"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812961    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6ace45-a35b-440a-8e0c-6e8c28b6782e" containerName="extract"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812968    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d10626c-cc9c-4d10-a10e-b5eb0a913903" containerName="pull"
Jul 16 21:46:02.813018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.812975    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d10626c-cc9c-4d10-a10e-b5eb0a913903" containerName="pull"
Jul 16 21:46:02.813714 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.813037    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d10626c-cc9c-4d10-a10e-b5eb0a913903" containerName="extract"
Jul 16 21:46:02.813714 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.813044    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e6ace45-a35b-440a-8e0c-6e8c28b6782e" containerName="extract"
Jul 16 21:46:02.813714 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.813051    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="849ade00-3944-418e-a2af-fcf8cc402926" containerName="extract"
Jul 16 21:46:02.813714 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.813057    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="494b5a83-79e7-4225-a5de-35d7b6e60e63" containerName="extract"
Jul 16 21:46:02.816117 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.816096    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-snmhq"
Jul 16 21:46:02.819693 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.819658    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-hfnbf\""
Jul 16 21:46:02.829295 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.829270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-snmhq"]
Jul 16 21:46:02.931413 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:02.931379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk5l7\" (UniqueName: \"kubernetes.io/projected/d50219a4-f550-417b-8938-6e31500983cd-kube-api-access-tk5l7\") pod \"authorino-operator-75cc8d5cb7-snmhq\" (UID: \"d50219a4-f550-417b-8938-6e31500983cd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-snmhq"
Jul 16 21:46:03.032057 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:03.032026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk5l7\" (UniqueName: \"kubernetes.io/projected/d50219a4-f550-417b-8938-6e31500983cd-kube-api-access-tk5l7\") pod \"authorino-operator-75cc8d5cb7-snmhq\" (UID: \"d50219a4-f550-417b-8938-6e31500983cd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-snmhq"
Jul 16 21:46:03.045315 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:03.045290    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk5l7\" (UniqueName: \"kubernetes.io/projected/d50219a4-f550-417b-8938-6e31500983cd-kube-api-access-tk5l7\") pod \"authorino-operator-75cc8d5cb7-snmhq\" (UID: \"d50219a4-f550-417b-8938-6e31500983cd\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-snmhq"
Jul 16 21:46:03.126266 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:03.126198    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-snmhq"
Jul 16 21:46:03.259077 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:03.259052    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-snmhq"]
Jul 16 21:46:03.260989 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:46:03.260961    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd50219a4_f550_417b_8938_6e31500983cd.slice/crio-e531e231382e3ab4a6512908d937a8d4b898b29ba712e88a5b92294dbab06c8f WatchSource:0}: Error finding container e531e231382e3ab4a6512908d937a8d4b898b29ba712e88a5b92294dbab06c8f: Status 404 returned error can't find the container with id e531e231382e3ab4a6512908d937a8d4b898b29ba712e88a5b92294dbab06c8f
Jul 16 21:46:03.482529 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:03.482496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-snmhq" event={"ID":"d50219a4-f550-417b-8938-6e31500983cd","Type":"ContainerStarted","Data":"e531e231382e3ab4a6512908d937a8d4b898b29ba712e88a5b92294dbab06c8f"}
Jul 16 21:46:06.046639 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:06.046606    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht"]
Jul 16 21:46:06.054086 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:06.054064    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht"
Jul 16 21:46:06.056980 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:06.056958    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 21:46:06.057318 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:06.057294    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-grb8f\""
Jul 16 21:46:06.069658 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:06.069637    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht"]
Jul 16 21:46:06.162167 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:06.162128    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc9wk\" (UniqueName: \"kubernetes.io/projected/e9399775-c7f5-4149-a953-a645510e285c-kube-api-access-nc9wk\") pod \"dns-operator-controller-manager-864dd78c4c-kvvht\" (UID: \"e9399775-c7f5-4149-a953-a645510e285c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht"
Jul 16 21:46:06.262564 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:06.262531    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc9wk\" (UniqueName: \"kubernetes.io/projected/e9399775-c7f5-4149-a953-a645510e285c-kube-api-access-nc9wk\") pod \"dns-operator-controller-manager-864dd78c4c-kvvht\" (UID: \"e9399775-c7f5-4149-a953-a645510e285c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht"
Jul 16 21:46:06.273737 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:06.273704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc9wk\" (UniqueName: \"kubernetes.io/projected/e9399775-c7f5-4149-a953-a645510e285c-kube-api-access-nc9wk\") pod \"dns-operator-controller-manager-864dd78c4c-kvvht\" (UID: \"e9399775-c7f5-4149-a953-a645510e285c\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht"
Jul 16 21:46:06.367531 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:06.367447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht"
Jul 16 21:46:06.896638 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:06.896615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht"]
Jul 16 21:46:06.898602 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:46:06.898577    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9399775_c7f5_4149_a953_a645510e285c.slice/crio-f56a0df484c7a99e3cebeebd69874f0001403d60f26ae898e426857b5c0d5865 WatchSource:0}: Error finding container f56a0df484c7a99e3cebeebd69874f0001403d60f26ae898e426857b5c0d5865: Status 404 returned error can't find the container with id f56a0df484c7a99e3cebeebd69874f0001403d60f26ae898e426857b5c0d5865
Jul 16 21:46:07.505708 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:07.505679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-snmhq" event={"ID":"d50219a4-f550-417b-8938-6e31500983cd","Type":"ContainerStarted","Data":"6e097a6864a9153b11556da8af2bfedf8c56e75e179d017d008e78abd86f404f"}
Jul 16 21:46:07.506147 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:07.505768    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-snmhq"
Jul 16 21:46:07.507131 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:07.507108    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht" event={"ID":"e9399775-c7f5-4149-a953-a645510e285c","Type":"ContainerStarted","Data":"f56a0df484c7a99e3cebeebd69874f0001403d60f26ae898e426857b5c0d5865"}
Jul 16 21:46:07.554614 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:07.554565    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-snmhq" podStartSLOduration=2.025437255 podStartE2EDuration="5.554548837s" totalImagesPullingTime="3.529111582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:46:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:46:07.553577147 +0000 UTC m=+432.379222468" watchObservedRunningTime="2026-07-16 21:46:07.554548837 +0000 UTC m=+432.380194203"
Jul 16 21:46:08.797308 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:08.797280    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"]
Jul 16 21:46:08.800319 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:08.800300    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:08.802806 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:08.802786    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-48tp8\""
Jul 16 21:46:08.810654 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:08.810633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"]
Jul 16 21:46:08.987641 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:08.987604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86znp\" (UniqueName: \"kubernetes.io/projected/e5351b19-9156-405e-8f11-c5bf162bd657-kube-api-access-86znp\") pod \"limitador-operator-controller-manager-859d7b78bd-92zzw\" (UID: \"e5351b19-9156-405e-8f11-c5bf162bd657\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:09.089079 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:09.088985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86znp\" (UniqueName: \"kubernetes.io/projected/e5351b19-9156-405e-8f11-c5bf162bd657-kube-api-access-86znp\") pod \"limitador-operator-controller-manager-859d7b78bd-92zzw\" (UID: \"e5351b19-9156-405e-8f11-c5bf162bd657\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:09.105437 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:09.105404    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86znp\" (UniqueName: \"kubernetes.io/projected/e5351b19-9156-405e-8f11-c5bf162bd657-kube-api-access-86znp\") pod \"limitador-operator-controller-manager-859d7b78bd-92zzw\" (UID: \"e5351b19-9156-405e-8f11-c5bf162bd657\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:09.111086 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:09.111056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:09.274029 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:09.274003    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"]
Jul 16 21:46:09.275798 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:46:09.275768    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5351b19_9156_405e_8f11_c5bf162bd657.slice/crio-9e9a6ed86ac464ef7b375fcad57e1f21e10a88923098dfa3e881c6acd80f0ebc WatchSource:0}: Error finding container 9e9a6ed86ac464ef7b375fcad57e1f21e10a88923098dfa3e881c6acd80f0ebc: Status 404 returned error can't find the container with id 9e9a6ed86ac464ef7b375fcad57e1f21e10a88923098dfa3e881c6acd80f0ebc
Jul 16 21:46:09.517683 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:09.517643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht" event={"ID":"e9399775-c7f5-4149-a953-a645510e285c","Type":"ContainerStarted","Data":"d6a411c4841c8c749ac4b3f935cea7fcc6b6bf19e08216db99eca1b7f3ab2677"}
Jul 16 21:46:09.517872 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:09.517781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht"
Jul 16 21:46:09.518951 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:09.518913    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw" event={"ID":"e5351b19-9156-405e-8f11-c5bf162bd657","Type":"ContainerStarted","Data":"9e9a6ed86ac464ef7b375fcad57e1f21e10a88923098dfa3e881c6acd80f0ebc"}
Jul 16 21:46:09.545261 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:09.545215    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht" podStartSLOduration=1.279224323 podStartE2EDuration="3.545202498s" totalImagesPullingTime="2.265978175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:46:09.5448438 +0000 UTC m=+434.370489099" watchObservedRunningTime="2026-07-16 21:46:09.545202498 +0000 UTC m=+434.370847797"
Jul 16 21:46:12.536669 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:12.536640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw" event={"ID":"e5351b19-9156-405e-8f11-c5bf162bd657","Type":"ContainerStarted","Data":"d94b81fbae9ddf18367aac5fc713f12661f43788adae256f333556781cdb96d9"}
Jul 16 21:46:12.537067 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:12.536741    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:12.555678 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:12.555633    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw" podStartSLOduration=1.395323593 podStartE2EDuration="4.555619023s" totalImagesPullingTime="3.16029543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:46:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:46:12.553617401 +0000 UTC m=+437.379262705" watchObservedRunningTime="2026-07-16 21:46:12.555619023 +0000 UTC m=+437.381264323"
Jul 16 21:46:18.514505 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:18.514416    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-snmhq"
Jul 16 21:46:20.527109 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:20.527075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kvvht"
Jul 16 21:46:23.462196 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.462156    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"]
Jul 16 21:46:23.465796 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.465772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.468077 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.468043    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 21:46:23.468077 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.468068    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 21:46:23.468256 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.468116    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mq8xk\""
Jul 16 21:46:23.473691 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.473672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"]
Jul 16 21:46:23.494837 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.494818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ae88d7e-5117-442c-8d78-9fe3efc3d3ff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5tnlg\" (UID: \"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.494952 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.494875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ae88d7e-5117-442c-8d78-9fe3efc3d3ff-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5tnlg\" (UID: \"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.494952 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.494892    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2b6c\" (UniqueName: \"kubernetes.io/projected/3ae88d7e-5117-442c-8d78-9fe3efc3d3ff-kube-api-access-h2b6c\") pod \"kuadrant-console-plugin-66b5774985-5tnlg\" (UID: \"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.544376 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.544353    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:23.595400 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.595373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ae88d7e-5117-442c-8d78-9fe3efc3d3ff-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5tnlg\" (UID: \"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.595572 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.595406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2b6c\" (UniqueName: \"kubernetes.io/projected/3ae88d7e-5117-442c-8d78-9fe3efc3d3ff-kube-api-access-h2b6c\") pod \"kuadrant-console-plugin-66b5774985-5tnlg\" (UID: \"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.595572 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.595465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ae88d7e-5117-442c-8d78-9fe3efc3d3ff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5tnlg\" (UID: \"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.596068 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.596042    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3ae88d7e-5117-442c-8d78-9fe3efc3d3ff-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-5tnlg\" (UID: \"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.598089 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.598065    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3ae88d7e-5117-442c-8d78-9fe3efc3d3ff-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-5tnlg\" (UID: \"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.604839 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.604814    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2b6c\" (UniqueName: \"kubernetes.io/projected/3ae88d7e-5117-442c-8d78-9fe3efc3d3ff-kube-api-access-h2b6c\") pod \"kuadrant-console-plugin-66b5774985-5tnlg\" (UID: \"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.775448 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.775370    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"
Jul 16 21:46:23.921656 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:23.921635    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg"]
Jul 16 21:46:23.923202 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:46:23.923173    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ae88d7e_5117_442c_8d78_9fe3efc3d3ff.slice/crio-ead298cba9a9efe68f7bf56919cb05657c6ffa6eef34772f5b8b09e9ca6d83b6 WatchSource:0}: Error finding container ead298cba9a9efe68f7bf56919cb05657c6ffa6eef34772f5b8b09e9ca6d83b6: Status 404 returned error can't find the container with id ead298cba9a9efe68f7bf56919cb05657c6ffa6eef34772f5b8b09e9ca6d83b6
Jul 16 21:46:24.597227 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:24.597191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg" event={"ID":"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff","Type":"ContainerStarted","Data":"ead298cba9a9efe68f7bf56919cb05657c6ffa6eef34772f5b8b09e9ca6d83b6"}
Jul 16 21:46:34.167357 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.167324    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"]
Jul 16 21:46:34.204478 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.204437    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"]
Jul 16 21:46:34.204645 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.204548    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:34.207671 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.207650    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mvd4n\""
Jul 16 21:46:34.288456 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.288426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmmz5\" (UniqueName: \"kubernetes.io/projected/35ade98f-d671-4d5b-a57e-ab8caf191ad9-kube-api-access-mmmz5\") pod \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" (UID: \"35ade98f-d671-4d5b-a57e-ab8caf191ad9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:34.288615 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.288503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35ade98f-d671-4d5b-a57e-ab8caf191ad9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" (UID: \"35ade98f-d671-4d5b-a57e-ab8caf191ad9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:34.389966 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.389921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35ade98f-d671-4d5b-a57e-ab8caf191ad9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" (UID: \"35ade98f-d671-4d5b-a57e-ab8caf191ad9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:34.390143 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.390021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmmz5\" (UniqueName: \"kubernetes.io/projected/35ade98f-d671-4d5b-a57e-ab8caf191ad9-kube-api-access-mmmz5\") pod \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" (UID: \"35ade98f-d671-4d5b-a57e-ab8caf191ad9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:34.390333 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.390311    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35ade98f-d671-4d5b-a57e-ab8caf191ad9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" (UID: \"35ade98f-d671-4d5b-a57e-ab8caf191ad9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:34.400217 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.400184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmmz5\" (UniqueName: \"kubernetes.io/projected/35ade98f-d671-4d5b-a57e-ab8caf191ad9-kube-api-access-mmmz5\") pod \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" (UID: \"35ade98f-d671-4d5b-a57e-ab8caf191ad9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:34.517686 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.517653    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:34.562703 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.562636    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"]
Jul 16 21:46:34.568764 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.568731    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"]
Jul 16 21:46:34.582778 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.582754    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"]
Jul 16 21:46:34.589415 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.589397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:46:34.603589 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.603565    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"]
Jul 16 21:46:34.613614 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.613586    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"]
Jul 16 21:46:34.613851 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.613825    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" containerName="manager" containerID="cri-o://d94b81fbae9ddf18367aac5fc713f12661f43788adae256f333556781cdb96d9" gracePeriod=2
Jul 16 21:46:34.619129 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.619070    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"]
Jul 16 21:46:34.635065 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:34.635021    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-92zzw\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:34.647297 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.647261    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl"]
Jul 16 21:46:34.647756 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.647734    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" containerName="manager"
Jul 16 21:46:34.647756 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.647757    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" containerName="manager"
Jul 16 21:46:34.647915 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.647850    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" containerName="manager"
Jul 16 21:46:34.652541 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.652521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl"
Jul 16 21:46:34.662155 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:34.662124    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-92zzw\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:34.671626 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.671593    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl"]
Jul 16 21:46:34.692231 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.692201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r94s\" (UniqueName: \"kubernetes.io/projected/ffde85a2-a711-41ca-b802-512c4b7d9f99-kube-api-access-7r94s\") pod \"limitador-operator-controller-manager-859d7b78bd-p4pdl\" (UID: \"ffde85a2-a711-41ca-b802-512c4b7d9f99\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl"
Jul 16 21:46:34.692358 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.692337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8dkb\" (UniqueName: \"kubernetes.io/projected/9da80a12-1500-4dc0-bde4-c098124b6f1e-kube-api-access-l8dkb\") pod \"kuadrant-operator-controller-manager-55467d9f7-flcjf\" (UID: \"9da80a12-1500-4dc0-bde4-c098124b6f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:46:34.692415 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.692376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da80a12-1500-4dc0-bde4-c098124b6f1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-flcjf\" (UID: \"9da80a12-1500-4dc0-bde4-c098124b6f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:46:34.793854 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.793771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8dkb\" (UniqueName: \"kubernetes.io/projected/9da80a12-1500-4dc0-bde4-c098124b6f1e-kube-api-access-l8dkb\") pod \"kuadrant-operator-controller-manager-55467d9f7-flcjf\" (UID: \"9da80a12-1500-4dc0-bde4-c098124b6f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:46:34.793854 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.793830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da80a12-1500-4dc0-bde4-c098124b6f1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-flcjf\" (UID: \"9da80a12-1500-4dc0-bde4-c098124b6f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:46:34.794112 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.793882    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r94s\" (UniqueName: \"kubernetes.io/projected/ffde85a2-a711-41ca-b802-512c4b7d9f99-kube-api-access-7r94s\") pod \"limitador-operator-controller-manager-859d7b78bd-p4pdl\" (UID: \"ffde85a2-a711-41ca-b802-512c4b7d9f99\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl"
Jul 16 21:46:34.794336 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.794316    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da80a12-1500-4dc0-bde4-c098124b6f1e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-flcjf\" (UID: \"9da80a12-1500-4dc0-bde4-c098124b6f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:46:34.813518 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.813485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8dkb\" (UniqueName: \"kubernetes.io/projected/9da80a12-1500-4dc0-bde4-c098124b6f1e-kube-api-access-l8dkb\") pod \"kuadrant-operator-controller-manager-55467d9f7-flcjf\" (UID: \"9da80a12-1500-4dc0-bde4-c098124b6f1e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:46:34.813697 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.813485    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r94s\" (UniqueName: \"kubernetes.io/projected/ffde85a2-a711-41ca-b802-512c4b7d9f99-kube-api-access-7r94s\") pod \"limitador-operator-controller-manager-859d7b78bd-p4pdl\" (UID: \"ffde85a2-a711-41ca-b802-512c4b7d9f99\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl"
Jul 16 21:46:34.901795 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.901761    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:46:34.980728 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:34.980692    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl"
Jul 16 21:46:35.672643 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:35.672605    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-92zzw\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:45.726461 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:45.726425    2563 generic.go:356] "Generic (PLEG): container finished" podID="e5351b19-9156-405e-8f11-c5bf162bd657" containerID="d94b81fbae9ddf18367aac5fc713f12661f43788adae256f333556781cdb96d9" exitCode=0
Jul 16 21:46:45.794847 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:45.794822    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"]
Jul 16 21:46:45.797736 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:46:45.797704    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9da80a12_1500_4dc0_bde4_c098124b6f1e.slice/crio-403095f6a2a48f31b5b21baa6f26482c5fb039603cfbd94cc80c332e5d50242b WatchSource:0}: Error finding container 403095f6a2a48f31b5b21baa6f26482c5fb039603cfbd94cc80c332e5d50242b: Status 404 returned error can't find the container with id 403095f6a2a48f31b5b21baa6f26482c5fb039603cfbd94cc80c332e5d50242b
Jul 16 21:46:45.808340 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:45.808311    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl"]
Jul 16 21:46:45.970958 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:46:45.970908    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffde85a2_a711_41ca_b802_512c4b7d9f99.slice/crio-a76ac7c62b42c288f9ceeba5f7914db00457fc7cf51f52fec94f70e5e3997b7c WatchSource:0}: Error finding container a76ac7c62b42c288f9ceeba5f7914db00457fc7cf51f52fec94f70e5e3997b7c: Status 404 returned error can't find the container with id a76ac7c62b42c288f9ceeba5f7914db00457fc7cf51f52fec94f70e5e3997b7c
Jul 16 21:46:46.001543 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.001521    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:46.003460 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:46.003433    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-92zzw\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:46.090326 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.090300    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86znp\" (UniqueName: \"kubernetes.io/projected/e5351b19-9156-405e-8f11-c5bf162bd657-kube-api-access-86znp\") pod \"e5351b19-9156-405e-8f11-c5bf162bd657\" (UID: \"e5351b19-9156-405e-8f11-c5bf162bd657\") "
Jul 16 21:46:46.092342 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.092316    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5351b19-9156-405e-8f11-c5bf162bd657-kube-api-access-86znp" (OuterVolumeSpecName: "kube-api-access-86znp") pod "e5351b19-9156-405e-8f11-c5bf162bd657" (UID: "e5351b19-9156-405e-8f11-c5bf162bd657"). InnerVolumeSpecName "kube-api-access-86znp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:46:46.191565 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.191536    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86znp\" (UniqueName: \"kubernetes.io/projected/e5351b19-9156-405e-8f11-c5bf162bd657-kube-api-access-86znp\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:46:46.735264 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.735182    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:46.735264 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.735238    2563 scope.go:117] "RemoveContainer" containerID="d94b81fbae9ddf18367aac5fc713f12661f43788adae256f333556781cdb96d9"
Jul 16 21:46:46.737224 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.737180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl" event={"ID":"ffde85a2-a711-41ca-b802-512c4b7d9f99","Type":"ContainerStarted","Data":"1d222aa109fa34885ba8a10e4c21f45826d9aea6258b2ef4a5dc5b355ce28e8f"}
Jul 16 21:46:46.737345 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.737241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl" event={"ID":"ffde85a2-a711-41ca-b802-512c4b7d9f99","Type":"ContainerStarted","Data":"a76ac7c62b42c288f9ceeba5f7914db00457fc7cf51f52fec94f70e5e3997b7c"}
Jul 16 21:46:46.737412 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.737352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl"
Jul 16 21:46:46.737733 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:46.737705    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-92zzw\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:46.738979 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.738931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf" event={"ID":"9da80a12-1500-4dc0-bde4-c098124b6f1e","Type":"ContainerStarted","Data":"403095f6a2a48f31b5b21baa6f26482c5fb039603cfbd94cc80c332e5d50242b"}
Jul 16 21:46:46.740860 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.740834    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg" event={"ID":"3ae88d7e-5117-442c-8d78-9fe3efc3d3ff","Type":"ContainerStarted","Data":"402afb7c38f77cf0ed75b55f2d3c5b046b5b6e1282fe3158359169d9c6b57749"}
Jul 16 21:46:46.758188 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:46.758163    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-92zzw\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:46.758288 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.758211    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl" podStartSLOduration=12.758198594 podStartE2EDuration="12.758198594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:46:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:46:46.756276332 +0000 UTC m=+471.581921632" watchObservedRunningTime="2026-07-16 21:46:46.758198594 +0000 UTC m=+471.583843894"
Jul 16 21:46:46.759849 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:46.759822    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-92zzw\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-92zzw"
Jul 16 21:46:46.782723 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:46.782674    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-5tnlg" podStartSLOduration=1.6747867429999999 podStartE2EDuration="23.782657435s" totalImagesPullingTime="22.107870692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:46:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:46:46.780017371 +0000 UTC m=+471.605662670" watchObservedRunningTime="2026-07-16 21:46:46.782657435 +0000 UTC m=+471.608302737"
Jul 16 21:46:47.674959 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:47.674916    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5351b19-9156-405e-8f11-c5bf162bd657" path="/var/lib/kubelet/pods/e5351b19-9156-405e-8f11-c5bf162bd657/volumes"
Jul 16 21:46:48.179829 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:48.179790    2563 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-zcctx_kuadrant-system_35ade98f-d671-4d5b-a57e-ab8caf191ad9_0(056b3c75e45c41d41ed41afecd4a96cec324cdfd7bc1ad90211b102e6484c588): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-zcctx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 16 21:46:48.180239 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:48.179852    2563 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-zcctx_kuadrant-system_35ade98f-d671-4d5b-a57e-ab8caf191ad9_0(056b3c75e45c41d41ed41afecd4a96cec324cdfd7bc1ad90211b102e6484c588): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-zcctx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:48.752769 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:48.752718    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:48.755264 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:48.755231    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="35ade98f-d671-4d5b-a57e-ab8caf191ad9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:48.789657 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:48.789628    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:48.793548 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:48.793523    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="35ade98f-d671-4d5b-a57e-ab8caf191ad9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:48.916923 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:48.916893    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmmz5\" (UniqueName: \"kubernetes.io/projected/35ade98f-d671-4d5b-a57e-ab8caf191ad9-kube-api-access-mmmz5\") pod \"35ade98f-d671-4d5b-a57e-ab8caf191ad9\" (UID: \"35ade98f-d671-4d5b-a57e-ab8caf191ad9\") "
Jul 16 21:46:48.917116 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:48.917035    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35ade98f-d671-4d5b-a57e-ab8caf191ad9-extensions-socket-volume\") pod \"35ade98f-d671-4d5b-a57e-ab8caf191ad9\" (UID: \"35ade98f-d671-4d5b-a57e-ab8caf191ad9\") "
Jul 16 21:46:48.917313 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:48.917287    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35ade98f-d671-4d5b-a57e-ab8caf191ad9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "35ade98f-d671-4d5b-a57e-ab8caf191ad9" (UID: "35ade98f-d671-4d5b-a57e-ab8caf191ad9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:46:48.919085 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:48.919061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35ade98f-d671-4d5b-a57e-ab8caf191ad9-kube-api-access-mmmz5" (OuterVolumeSpecName: "kube-api-access-mmmz5") pod "35ade98f-d671-4d5b-a57e-ab8caf191ad9" (UID: "35ade98f-d671-4d5b-a57e-ab8caf191ad9"). InnerVolumeSpecName "kube-api-access-mmmz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:46:49.018244 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:49.018158    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/35ade98f-d671-4d5b-a57e-ab8caf191ad9-extensions-socket-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:46:49.018244 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:49.018194    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmmz5\" (UniqueName: \"kubernetes.io/projected/35ade98f-d671-4d5b-a57e-ab8caf191ad9-kube-api-access-mmmz5\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:46:49.674492 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:49.674460    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35ade98f-d671-4d5b-a57e-ab8caf191ad9" path="/var/lib/kubelet/pods/35ade98f-d671-4d5b-a57e-ab8caf191ad9/volumes"
Jul 16 21:46:49.758007 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:49.757974    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:49.760171 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:49.760091    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="35ade98f-d671-4d5b-a57e-ab8caf191ad9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:49.762224 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:49.762199    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="35ade98f-d671-4d5b-a57e-ab8caf191ad9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:50.764601 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:50.764566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf" event={"ID":"9da80a12-1500-4dc0-bde4-c098124b6f1e","Type":"ContainerStarted","Data":"e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829"}
Jul 16 21:46:50.765008 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:50.764708    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:46:50.786520 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:46:50.786486    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-zcctx\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="35ade98f-d671-4d5b-a57e-ab8caf191ad9" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-zcctx"
Jul 16 21:46:57.750328 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:57.750296    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p4pdl"
Jul 16 21:46:57.767528 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:46:57.767471    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf" podStartSLOduration=19.47324784 podStartE2EDuration="23.767457255s" totalImagesPullingTime="4.294209415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:46:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:46:50.784648495 +0000 UTC m=+475.610293795" watchObservedRunningTime="2026-07-16 21:46:57.767457255 +0000 UTC m=+482.593102554"
Jul 16 21:47:01.772214 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:01.772186    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:47:13.939496 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:13.939462    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"]
Jul 16 21:47:13.939873 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:13.939684    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf" podUID="9da80a12-1500-4dc0-bde4-c098124b6f1e" containerName="manager" containerID="cri-o://e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829" gracePeriod=10
Jul 16 21:47:14.248706 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.248680    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:47:14.429189 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.429154    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da80a12-1500-4dc0-bde4-c098124b6f1e-extensions-socket-volume\") pod \"9da80a12-1500-4dc0-bde4-c098124b6f1e\" (UID: \"9da80a12-1500-4dc0-bde4-c098124b6f1e\") "
Jul 16 21:47:14.429368 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.429208    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8dkb\" (UniqueName: \"kubernetes.io/projected/9da80a12-1500-4dc0-bde4-c098124b6f1e-kube-api-access-l8dkb\") pod \"9da80a12-1500-4dc0-bde4-c098124b6f1e\" (UID: \"9da80a12-1500-4dc0-bde4-c098124b6f1e\") "
Jul 16 21:47:14.429502 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.429479    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9da80a12-1500-4dc0-bde4-c098124b6f1e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9da80a12-1500-4dc0-bde4-c098124b6f1e" (UID: "9da80a12-1500-4dc0-bde4-c098124b6f1e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 21:47:14.431420 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.431399    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9da80a12-1500-4dc0-bde4-c098124b6f1e-kube-api-access-l8dkb" (OuterVolumeSpecName: "kube-api-access-l8dkb") pod "9da80a12-1500-4dc0-bde4-c098124b6f1e" (UID: "9da80a12-1500-4dc0-bde4-c098124b6f1e"). InnerVolumeSpecName "kube-api-access-l8dkb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 21:47:14.530315 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.530244    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9da80a12-1500-4dc0-bde4-c098124b6f1e-extensions-socket-volume\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:47:14.530315 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.530268    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8dkb\" (UniqueName: \"kubernetes.io/projected/9da80a12-1500-4dc0-bde4-c098124b6f1e-kube-api-access-l8dkb\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 21:47:14.883205 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.883128    2563 generic.go:356] "Generic (PLEG): container finished" podID="9da80a12-1500-4dc0-bde4-c098124b6f1e" containerID="e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829" exitCode=0
Jul 16 21:47:14.883205 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.883172    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf" event={"ID":"9da80a12-1500-4dc0-bde4-c098124b6f1e","Type":"ContainerDied","Data":"e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829"}
Jul 16 21:47:14.883378 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.883210    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf" event={"ID":"9da80a12-1500-4dc0-bde4-c098124b6f1e","Type":"ContainerDied","Data":"403095f6a2a48f31b5b21baa6f26482c5fb039603cfbd94cc80c332e5d50242b"}
Jul 16 21:47:14.883378 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.883231    2563 scope.go:117] "RemoveContainer" containerID="e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829"
Jul 16 21:47:14.883378 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.883174    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"
Jul 16 21:47:14.892278 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.892261    2563 scope.go:117] "RemoveContainer" containerID="e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829"
Jul 16 21:47:14.892503 ip-10-0-142-10 kubenswrapper[2563]: E0716 21:47:14.892484    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829\": container with ID starting with e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829 not found: ID does not exist" containerID="e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829"
Jul 16 21:47:14.892597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.892510    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829"} err="failed to get container status \"e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829\": rpc error: code = NotFound desc = could not find container \"e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829\": container with ID starting with e5008d49b12795bc786a081f322433d9ae349d76e0efb832cec7c2bef53c1829 not found: ID does not exist"
Jul 16 21:47:14.905305 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.905283    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"]
Jul 16 21:47:14.909770 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:14.909752    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-flcjf"]
Jul 16 21:47:15.673053 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:15.673013    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9da80a12-1500-4dc0-bde4-c098124b6f1e" path="/var/lib/kubelet/pods/9da80a12-1500-4dc0-bde4-c098124b6f1e/volumes"
Jul 16 21:47:18.247452 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.247423    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"]
Jul 16 21:47:18.248040 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.247738    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9da80a12-1500-4dc0-bde4-c098124b6f1e" containerName="manager"
Jul 16 21:47:18.248040 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.247749    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9da80a12-1500-4dc0-bde4-c098124b6f1e" containerName="manager"
Jul 16 21:47:18.248040 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.247805    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9da80a12-1500-4dc0-bde4-c098124b6f1e" containerName="manager"
Jul 16 21:47:18.249958 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.249920    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.252232 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.252210    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-d97q7\""
Jul 16 21:47:18.263084 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.263056    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"]
Jul 16 21:47:18.359659 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.359626    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.359838 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.359679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.359838 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.359738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.359838 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.359776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.359838 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.359823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9pkl\" (UniqueName: \"kubernetes.io/projected/5905f494-56a5-4419-9bac-f370f36ee5d1-kube-api-access-p9pkl\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.360052 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.359850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.360052 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.359868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5905f494-56a5-4419-9bac-f370f36ee5d1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.360052 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.359974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.360052 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.359998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.460792 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.460750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9pkl\" (UniqueName: \"kubernetes.io/projected/5905f494-56a5-4419-9bac-f370f36ee5d1-kube-api-access-p9pkl\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.460792 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.460799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461102 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.460850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5905f494-56a5-4419-9bac-f370f36ee5d1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461102 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.460906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461102 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.460926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461102 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.460973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461102 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.461027    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461102 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.461073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461404 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.461106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461404 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.461261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461404 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.461308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461404 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.461372    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461666 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.461643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.461705 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.461670    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5905f494-56a5-4419-9bac-f370f36ee5d1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.463678 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.463654    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.464036 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.464017    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.469402 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.469374    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5905f494-56a5-4419-9bac-f370f36ee5d1-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.470079 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.470060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9pkl\" (UniqueName: \"kubernetes.io/projected/5905f494-56a5-4419-9bac-f370f36ee5d1-kube-api-access-p9pkl\") pod \"maas-default-gateway-openshift-default-56654dcf7-nwr4z\" (UID: \"5905f494-56a5-4419-9bac-f370f36ee5d1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.560467 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.560391    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:18.704076 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.704057    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"]
Jul 16 21:47:18.706407 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:47:18.706379    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5905f494_56a5_4419_9bac_f370f36ee5d1.slice/crio-dbde678c602d35dd7afc8404d3165225e074330a0ba57f99eeab3ca8c8b878ad WatchSource:0}: Error finding container dbde678c602d35dd7afc8404d3165225e074330a0ba57f99eeab3ca8c8b878ad: Status 404 returned error can't find the container with id dbde678c602d35dd7afc8404d3165225e074330a0ba57f99eeab3ca8c8b878ad
Jul 16 21:47:18.708586 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.708549    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:47:18.708668 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.708636    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:47:18.708707 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.708677    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:47:18.906068 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.905973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z" event={"ID":"5905f494-56a5-4419-9bac-f370f36ee5d1","Type":"ContainerStarted","Data":"81e3fd7d23a4ba6100adf758528e65a68845dc554bdddfb69e4fc6a5c14cfe43"}
Jul 16 21:47:18.906068 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.906038    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z" event={"ID":"5905f494-56a5-4419-9bac-f370f36ee5d1","Type":"ContainerStarted","Data":"dbde678c602d35dd7afc8404d3165225e074330a0ba57f99eeab3ca8c8b878ad"}
Jul 16 21:47:18.934508 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:18.934461    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z" podStartSLOduration=0.934445851 podStartE2EDuration="934.445851ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:47:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:47:18.925827188 +0000 UTC m=+503.751472499" watchObservedRunningTime="2026-07-16 21:47:18.934445851 +0000 UTC m=+503.760091150"
Jul 16 21:47:19.560993 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:19.560953    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:19.565454 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:19.565430    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:19.911380 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:19.911304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:19.912282 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:19.912266    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:47:20.895589 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:20.895560    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:47:20.918013 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:20.917981    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:47:20.918160 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:20.918072    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"
Jul 16 21:47:20.920280 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:20.920259    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 21:47:20.925908 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:20.925604    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:47:21.083520 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:21.083484    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4cbafe6-6676-4c91-845b-bbeaee7b14c4-config-file\") pod \"limitador-limitador-54d6d988d5-5nwtr\" (UID: \"c4cbafe6-6676-4c91-845b-bbeaee7b14c4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"
Jul 16 21:47:21.083727 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:21.083561    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-757ql\" (UniqueName: \"kubernetes.io/projected/c4cbafe6-6676-4c91-845b-bbeaee7b14c4-kube-api-access-757ql\") pod \"limitador-limitador-54d6d988d5-5nwtr\" (UID: \"c4cbafe6-6676-4c91-845b-bbeaee7b14c4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"
Jul 16 21:47:21.184161 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:21.184130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4cbafe6-6676-4c91-845b-bbeaee7b14c4-config-file\") pod \"limitador-limitador-54d6d988d5-5nwtr\" (UID: \"c4cbafe6-6676-4c91-845b-bbeaee7b14c4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"
Jul 16 21:47:21.184320 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:21.184190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-757ql\" (UniqueName: \"kubernetes.io/projected/c4cbafe6-6676-4c91-845b-bbeaee7b14c4-kube-api-access-757ql\") pod \"limitador-limitador-54d6d988d5-5nwtr\" (UID: \"c4cbafe6-6676-4c91-845b-bbeaee7b14c4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"
Jul 16 21:47:21.184831 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:21.184811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c4cbafe6-6676-4c91-845b-bbeaee7b14c4-config-file\") pod \"limitador-limitador-54d6d988d5-5nwtr\" (UID: \"c4cbafe6-6676-4c91-845b-bbeaee7b14c4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"
Jul 16 21:47:21.192639 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:21.192603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-757ql\" (UniqueName: \"kubernetes.io/projected/c4cbafe6-6676-4c91-845b-bbeaee7b14c4-kube-api-access-757ql\") pod \"limitador-limitador-54d6d988d5-5nwtr\" (UID: \"c4cbafe6-6676-4c91-845b-bbeaee7b14c4\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"
Jul 16 21:47:21.229430 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:21.229398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"
Jul 16 21:47:21.364762 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:21.364672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:47:21.367555 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:47:21.367523    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4cbafe6_6676_4c91_845b_bbeaee7b14c4.slice/crio-77bfc51833c95d189177f4a7fba58fd9049a20470f75678065236722f7f79097 WatchSource:0}: Error finding container 77bfc51833c95d189177f4a7fba58fd9049a20470f75678065236722f7f79097: Status 404 returned error can't find the container with id 77bfc51833c95d189177f4a7fba58fd9049a20470f75678065236722f7f79097
Jul 16 21:47:21.925055 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:21.924974    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr" event={"ID":"c4cbafe6-6676-4c91-845b-bbeaee7b14c4","Type":"ContainerStarted","Data":"77bfc51833c95d189177f4a7fba58fd9049a20470f75678065236722f7f79097"}
Jul 16 21:47:24.944365 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:24.944335    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr" event={"ID":"c4cbafe6-6676-4c91-845b-bbeaee7b14c4","Type":"ContainerStarted","Data":"49b02018bbe89051d5458e6c4f408f0c3bb3edc89d917d27895bd99e637413f2"}
Jul 16 21:47:24.944737 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:24.944400    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"
Jul 16 21:47:24.967888 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:24.967845    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr" podStartSLOduration=2.442046957 podStartE2EDuration="4.967830136s" totalImagesPullingTime="2.525783179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:47:24.966489412 +0000 UTC m=+509.792134709" watchObservedRunningTime="2026-07-16 21:47:24.967830136 +0000 UTC m=+509.793475436"
Jul 16 21:47:35.950263 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:47:35.950227    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"
Jul 16 21:48:36.498614 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:36.498577    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:48:44.351093 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:44.351009    2563 generic.go:356] "Generic (PLEG): container finished" podID="5905f494-56a5-4419-9bac-f370f36ee5d1" containerID="81e3fd7d23a4ba6100adf758528e65a68845dc554bdddfb69e4fc6a5c14cfe43" exitCode=0
Jul 16 21:48:44.351093 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:44.351079    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z" event={"ID":"5905f494-56a5-4419-9bac-f370f36ee5d1","Type":"ContainerDied","Data":"81e3fd7d23a4ba6100adf758528e65a68845dc554bdddfb69e4fc6a5c14cfe43"}
Jul 16 21:48:44.351534 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:44.351429    2563 scope.go:117] "RemoveContainer" containerID="81e3fd7d23a4ba6100adf758528e65a68845dc554bdddfb69e4fc6a5c14cfe43"
Jul 16 21:48:44.352394 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:44.352369    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:48:44.352462 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:44.352446    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:48:44.352506 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:44.352484    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 21:48:45.359583 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:45.359554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z" event={"ID":"5905f494-56a5-4419-9bac-f370f36ee5d1","Type":"ContainerStarted","Data":"edf288d79954bb2a7639212deda86a5d80e84fc436160aa5ef480ca94051af5a"}
Jul 16 21:48:45.561222 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:45.561186    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:48:45.562400 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:45.562375    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nwr4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 21:48:45.562511 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:45.562423    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z" podUID="5905f494-56a5-4419-9bac-f370f36ee5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 21:48:46.561583 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:46.561542    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nwr4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 21:48:46.562050 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:46.561601    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z" podUID="5905f494-56a5-4419-9bac-f370f36ee5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 21:48:47.561194 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:47.561159    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nwr4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 21:48:47.561366 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:47.561217    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z" podUID="5905f494-56a5-4419-9bac-f370f36ee5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 21:48:48.561292 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:48.561258    2563 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-nwr4z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body=
Jul 16 21:48:48.561689 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:48.561320    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z" podUID="5905f494-56a5-4419-9bac-f370f36ee5d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused"
Jul 16 21:48:49.564955 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:49.564905    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:48:49.565399 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:49.565315    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:48:49.566044 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:49.566024    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-nwr4z"
Jul 16 21:48:52.913260 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:48:52.913226    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:49:02.995588 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:02.995556    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:49:20.095695 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:20.095614    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:49:50.901017 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.900978    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"]
Jul 16 21:49:50.903504 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.903486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:50.906039 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.906019    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 21:49:50.906787 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.906766    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 16 21:49:50.906875 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.906773    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 21:49:50.906875 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.906852    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9l2xf\""
Jul 16 21:49:50.915841 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.915818    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"]
Jul 16 21:49:50.993170 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.993137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:50.993332 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.993176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:50.993332 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.993198    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:50.993332 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.993217    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:50.993332 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.993277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpm2z\" (UniqueName: \"kubernetes.io/projected/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-kube-api-access-rpm2z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:50.993332 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:50.993323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.094506 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.094472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.094506 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.094514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.094745 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.094537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.094802 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.094753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.094857 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.094803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpm2z\" (UniqueName: \"kubernetes.io/projected/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-kube-api-access-rpm2z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.094857 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.094847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.094989 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.094857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.094989 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.094870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.095183 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.095164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.097024 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.097006    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.097329 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.097307    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.103785 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.103756    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpm2z\" (UniqueName: \"kubernetes.io/projected/dfa03f5f-7ea1-444d-9e44-8952e5a2f55d-kube-api-access-rpm2z\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k\" (UID: \"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.213651 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.213618    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:49:51.354297 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.354274    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"]
Jul 16 21:49:51.357014 ip-10-0-142-10 kubenswrapper[2563]: W0716 21:49:51.356985    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfa03f5f_7ea1_444d_9e44_8952e5a2f55d.slice/crio-2bcf85f83fdace17aba4d15af919032117f0cd1a6be1373394d047eb84e3367f WatchSource:0}: Error finding container 2bcf85f83fdace17aba4d15af919032117f0cd1a6be1373394d047eb84e3367f: Status 404 returned error can't find the container with id 2bcf85f83fdace17aba4d15af919032117f0cd1a6be1373394d047eb84e3367f
Jul 16 21:49:51.358372 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.358355    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 21:49:51.691236 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:51.691200    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k" event={"ID":"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d","Type":"ContainerStarted","Data":"2bcf85f83fdace17aba4d15af919032117f0cd1a6be1373394d047eb84e3367f"}
Jul 16 21:49:52.590141 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:52.590107    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:49:52.699086 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:52.699052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k" event={"ID":"dfa03f5f-7ea1-444d-9e44-8952e5a2f55d","Type":"ContainerStarted","Data":"414a56e07d6b0d94275cf435ea387781379f5811d2ca63d19cc1697ea89e5c99"}
Jul 16 21:49:52.718825 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:49:52.718781    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k" podStartSLOduration=1.692514592 podStartE2EDuration="2.718767738s" totalImagesPullingTime="1.026253146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 21:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 21:49:52.717204149 +0000 UTC m=+657.542849457" watchObservedRunningTime="2026-07-16 21:49:52.718767738 +0000 UTC m=+657.544413037"
Jul 16 21:50:01.214229 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:50:01.214194    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:50:01.214613 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:50:01.214258    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:50:01.226589 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:50:01.226569    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:50:01.765700 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:50:01.765675    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k"
Jul 16 21:50:02.098221 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:50:02.098129    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:50:16.995731 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:50:16.995692    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:51:39.300986 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:51:39.300950    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:51:51.292066 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:51:51.292035    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:52:01.391494 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:52:01.391462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:52:09.796343 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:52:09.796297    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:52:21.290576 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:52:21.290496    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:52:49.703128 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:52:49.703099    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:53:01.791593 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:53:01.791557    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:53:36.687391 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:53:36.687353    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:53:46.495514 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:53:46.495478    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:53:57.193375 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:53:57.193338    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:54:04.989018 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:54:04.988983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:54:16.195867 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:54:16.195830    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:54:28.797523 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:54:28.797490    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:54:39.498310 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:54:39.498277    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:54:49.896210 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:54:49.896163    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:55:10.701375 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:55:10.701338    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:55:23.191742 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:55:23.191662    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:55:45.198982 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:55:45.198932    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:55:57.888144 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:55:57.888112    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:56:14.001597 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:56:14.001561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:56:23.890909 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:56:23.890879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:56:40.398429 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:56:40.398393    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:58:40.694993 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:58:40.694894    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:58:49.789730 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:58:49.789693    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:59:03.027161 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:59:03.027129    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:59:13.698253 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:59:13.698220    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:59:26.092500 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:59:26.092454    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:59:35.587486 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:59:35.587449    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:59:44.691202 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:59:44.691169    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 21:59:56.092265 ip-10-0-142-10 kubenswrapper[2563]: I0716 21:59:56.092170    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:00:06.098859 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:00:06.098817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:00:15.395456 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:00:15.395424    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:00:29.496763 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:00:29.496731    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:00:47.593206 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:00:47.593173    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:00:56.996692 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:00:56.996656    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:01:08.590261 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:01:08.590230    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:01:17.304394 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:01:17.304303    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:01:29.391386 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:01:29.391346    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:01:45.194959 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:01:45.194892    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:01:54.799289 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:01:54.799255    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:02:04.786603 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:02:04.786566    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:02:14.192508 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:02:14.192474    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:02:24.689924 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:02:24.689890    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:02:41.484276 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:02:41.484229    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:02:51.095550 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:02:51.095468    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:03:01.401087 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:03:01.401059    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:03:11.695956 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:03:11.695906    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:03:24.089868 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:03:24.089836    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:03:33.691844 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:03:33.691810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:03:40.688021 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:03:40.687987    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:03:57.591718 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:03:57.591683    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:04:08.993713 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:08.993671    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:04:18.697531 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:18.697445    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:04:32.886693 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:32.886656    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:04:41.695073 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:41.695041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:04:51.376278 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.376245    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"]
Jul 16 22:04:51.379265 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.379244    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.381846 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.381460    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-997f8b52-openshift-default-dockercfg-xwvmb\""
Jul 16 22:04:51.402428 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.402407    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"]
Jul 16 22:04:51.477235 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.477204    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9qkq\" (UniqueName: \"kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-kube-api-access-b9qkq\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.477455 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.477248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bd63892-bb5d-4500-a0c2-09b7fddba718-istiod-ca-cert\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.477455 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.477294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-envoy\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.477455 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.477325    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-certs\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.477455 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.477360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-podinfo\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.477455 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.477417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-token\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.477842 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.477490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-socket\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.477842 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.477519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-credential-socket\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.477842 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.477547    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-data\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.578718 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.578687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9qkq\" (UniqueName: \"kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-kube-api-access-b9qkq\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.578718 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.578726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bd63892-bb5d-4500-a0c2-09b7fddba718-istiod-ca-cert\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.578979 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.578742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-envoy\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.578979 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.578762    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-certs\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.578979 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.578790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-podinfo\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.578979 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.578806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-token\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.578979 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.578828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-socket\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.578979 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.578843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-credential-socket\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.578979 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.578859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-data\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.579414 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.579377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-socket\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.579477 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.579419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-certs\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.579477 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.579435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-data\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.579583 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.579502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-credential-socket\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.579689 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.579670    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bd63892-bb5d-4500-a0c2-09b7fddba718-istiod-ca-cert\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.581324 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.581308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-envoy\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.581548 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.581528    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-podinfo\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.586790 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.586765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-token\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.587145 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.587126    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9qkq\" (UniqueName: \"kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-kube-api-access-b9qkq\") pod \"e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") " pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.690070 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.690045    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:51.827478 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.827439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"]
Jul 16 22:04:51.828367 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:04:51.828329    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd63892_bb5d_4500_a0c2_09b7fddba718.slice/crio-fffdf3b053736fb73d9cdea21f634ddcd10082ac291d9abc41b1cfe096ccf355 WatchSource:0}: Error finding container fffdf3b053736fb73d9cdea21f634ddcd10082ac291d9abc41b1cfe096ccf355: Status 404 returned error can't find the container with id fffdf3b053736fb73d9cdea21f634ddcd10082ac291d9abc41b1cfe096ccf355
Jul 16 22:04:51.830495 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.830463    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:04:51.830587 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.830526    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:04:51.830587 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.830553    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:04:51.896021 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:51.895996    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:04:52.219931 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:52.219900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd" event={"ID":"1bd63892-bb5d-4500-a0c2-09b7fddba718","Type":"ContainerStarted","Data":"40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668"}
Jul 16 22:04:52.220125 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:52.219981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd" event={"ID":"1bd63892-bb5d-4500-a0c2-09b7fddba718","Type":"ContainerStarted","Data":"fffdf3b053736fb73d9cdea21f634ddcd10082ac291d9abc41b1cfe096ccf355"}
Jul 16 22:04:52.260383 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:52.260336    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd" podStartSLOduration=1.260319779 podStartE2EDuration="1.260319779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:04:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:04:52.256477939 +0000 UTC m=+1557.082123239" watchObservedRunningTime="2026-07-16 22:04:52.260319779 +0000 UTC m=+1557.085965078"
Jul 16 22:04:52.690706 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:52.690680    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:52.695185 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:52.695162    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:53.225087 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:53.225058    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:53.226036 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:53.226004    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:04:57.847570 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:57.847535    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"]
Jul 16 22:04:57.848030 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:04:57.847706    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd" podUID="1bd63892-bb5d-4500-a0c2-09b7fddba718" containerName="istio-proxy" containerID="cri-o://40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668" gracePeriod=30
Jul 16 22:05:03.103409 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.103386    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:05:03.182317 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182294    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-token\") pod \"1bd63892-bb5d-4500-a0c2-09b7fddba718\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") "
Jul 16 22:05:03.182463 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182333    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-podinfo\") pod \"1bd63892-bb5d-4500-a0c2-09b7fddba718\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") "
Jul 16 22:05:03.182463 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182361    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-socket\") pod \"1bd63892-bb5d-4500-a0c2-09b7fddba718\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") "
Jul 16 22:05:03.182463 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182407    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-certs\") pod \"1bd63892-bb5d-4500-a0c2-09b7fddba718\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") "
Jul 16 22:05:03.182588 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182535    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-credential-socket\") pod \"1bd63892-bb5d-4500-a0c2-09b7fddba718\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") "
Jul 16 22:05:03.182640 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182593    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bd63892-bb5d-4500-a0c2-09b7fddba718-istiod-ca-cert\") pod \"1bd63892-bb5d-4500-a0c2-09b7fddba718\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") "
Jul 16 22:05:03.182640 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182619    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-envoy\") pod \"1bd63892-bb5d-4500-a0c2-09b7fddba718\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") "
Jul 16 22:05:03.182740 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182641    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-data\") pod \"1bd63892-bb5d-4500-a0c2-09b7fddba718\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") "
Jul 16 22:05:03.182740 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182695    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1bd63892-bb5d-4500-a0c2-09b7fddba718" (UID: "1bd63892-bb5d-4500-a0c2-09b7fddba718"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:03.182740 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182706    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9qkq\" (UniqueName: \"kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-kube-api-access-b9qkq\") pod \"1bd63892-bb5d-4500-a0c2-09b7fddba718\" (UID: \"1bd63892-bb5d-4500-a0c2-09b7fddba718\") "
Jul 16 22:05:03.182740 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182722    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1bd63892-bb5d-4500-a0c2-09b7fddba718" (UID: "1bd63892-bb5d-4500-a0c2-09b7fddba718"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:03.182933 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.182827    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1bd63892-bb5d-4500-a0c2-09b7fddba718" (UID: "1bd63892-bb5d-4500-a0c2-09b7fddba718"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:03.183019 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.183000    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd63892-bb5d-4500-a0c2-09b7fddba718-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1bd63892-bb5d-4500-a0c2-09b7fddba718" (UID: "1bd63892-bb5d-4500-a0c2-09b7fddba718"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:05:03.183354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.183283    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:03.183354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.183319    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bd63892-bb5d-4500-a0c2-09b7fddba718-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:03.183354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.183333    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:03.183354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.183347    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:03.183901 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.183874    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-data" (OuterVolumeSpecName: "istio-data") pod "1bd63892-bb5d-4500-a0c2-09b7fddba718" (UID: "1bd63892-bb5d-4500-a0c2-09b7fddba718"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:03.184806 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.184778    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1bd63892-bb5d-4500-a0c2-09b7fddba718" (UID: "1bd63892-bb5d-4500-a0c2-09b7fddba718"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:05:03.184992 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.184952    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1bd63892-bb5d-4500-a0c2-09b7fddba718" (UID: "1bd63892-bb5d-4500-a0c2-09b7fddba718"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:03.184992 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.184974    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-token" (OuterVolumeSpecName: "istio-token") pod "1bd63892-bb5d-4500-a0c2-09b7fddba718" (UID: "1bd63892-bb5d-4500-a0c2-09b7fddba718"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:05:03.185205 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.185181    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-kube-api-access-b9qkq" (OuterVolumeSpecName: "kube-api-access-b9qkq") pod "1bd63892-bb5d-4500-a0c2-09b7fddba718" (UID: "1bd63892-bb5d-4500-a0c2-09b7fddba718"). InnerVolumeSpecName "kube-api-access-b9qkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:05:03.275983 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.275928    2563 generic.go:356] "Generic (PLEG): container finished" podID="1bd63892-bb5d-4500-a0c2-09b7fddba718" containerID="40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668" exitCode=0
Jul 16 22:05:03.276109 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.275995    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"
Jul 16 22:05:03.276109 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.276037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd" event={"ID":"1bd63892-bb5d-4500-a0c2-09b7fddba718","Type":"ContainerDied","Data":"40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668"}
Jul 16 22:05:03.276109 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.276091    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd" event={"ID":"1bd63892-bb5d-4500-a0c2-09b7fddba718","Type":"ContainerDied","Data":"fffdf3b053736fb73d9cdea21f634ddcd10082ac291d9abc41b1cfe096ccf355"}
Jul 16 22:05:03.276208 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.276117    2563 scope.go:117] "RemoveContainer" containerID="40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668"
Jul 16 22:05:03.283907 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.283885    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:03.284015 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.283911    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:03.284015 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.283920    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:03.284015 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.283928    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bd63892-bb5d-4500-a0c2-09b7fddba718-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:03.284015 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.283958    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9qkq\" (UniqueName: \"kubernetes.io/projected/1bd63892-bb5d-4500-a0c2-09b7fddba718-kube-api-access-b9qkq\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:03.285527 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.285508    2563 scope.go:117] "RemoveContainer" containerID="40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668"
Jul 16 22:05:03.285777 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:05:03.285751    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668\": container with ID starting with 40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668 not found: ID does not exist" containerID="40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668"
Jul 16 22:05:03.285818 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.285785    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668"} err="failed to get container status \"40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668\": rpc error: code = NotFound desc = could not find container \"40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668\": container with ID starting with 40fb924b9fe4525725f721b57ed636e5bc7add3a12f8e93ffeb4579ae1074668 not found: ID does not exist"
Jul 16 22:05:03.300634 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.300613    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"]
Jul 16 22:05:03.309022 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.308065    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-997f8b52-openshift-default-6ddc7d9fc9-wgfwd"]
Jul 16 22:05:03.673578 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:03.673499    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bd63892-bb5d-4500-a0c2-09b7fddba718" path="/var/lib/kubelet/pods/1bd63892-bb5d-4500-a0c2-09b7fddba718/volumes"
Jul 16 22:05:04.247323 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.247295    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"]
Jul 16 22:05:04.247790 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.247771    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bd63892-bb5d-4500-a0c2-09b7fddba718" containerName="istio-proxy"
Jul 16 22:05:04.247862 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.247792    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bd63892-bb5d-4500-a0c2-09b7fddba718" containerName="istio-proxy"
Jul 16 22:05:04.247920 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.247903    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bd63892-bb5d-4500-a0c2-09b7fddba718" containerName="istio-proxy"
Jul 16 22:05:04.252405 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.252386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.258347 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.258326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9bc14df8-openshift-default-dockercfg-mpbhb\""
Jul 16 22:05:04.277698 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.277673    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"]
Jul 16 22:05:04.395032 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.394998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-podinfo\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.395221 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.395037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-certs\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.395221 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.395060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-credential-socket\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.395221 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.395084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r92tj\" (UniqueName: \"kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-kube-api-access-r92tj\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.395221 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.395103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9aa79e-d315-4d92-a204-f0631d9d1018-istiod-ca-cert\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.395221 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.395121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-socket\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.395221 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.395148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-data\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.395221 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.395183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-envoy\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.395453 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.395228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-token\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.496530 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.496443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-podinfo\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.496530 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.496491    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-certs\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.496749 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.496624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-credential-socket\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.496749 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.496679    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r92tj\" (UniqueName: \"kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-kube-api-access-r92tj\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.496749 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.496713    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9aa79e-d315-4d92-a204-f0631d9d1018-istiod-ca-cert\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.496749 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.496740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-socket\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.497004 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.496901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-certs\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.497004 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.496965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-data\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.497004 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.496979    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-credential-socket\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.497175 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.497013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-envoy\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.497175 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.497076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-token\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.497175 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.497093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-socket\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.497334 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.497262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-data\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.497410 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.497395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9aa79e-d315-4d92-a204-f0631d9d1018-istiod-ca-cert\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.499238 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.499217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-envoy\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.499238 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.499232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-podinfo\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.506890 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.506863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-token\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.507135 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.507114    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r92tj\" (UniqueName: \"kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-kube-api-access-r92tj\") pod \"e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") " pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.562312 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.562291    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:04.697778 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.697750    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"]
Jul 16 22:05:04.699559 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:05:04.699533    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9aa79e_d315_4d92_a204_f0631d9d1018.slice/crio-a246f326d86ec7996b78c5b3770a65e07a09129f8f53b7fa77af5766bde34c18 WatchSource:0}: Error finding container a246f326d86ec7996b78c5b3770a65e07a09129f8f53b7fa77af5766bde34c18: Status 404 returned error can't find the container with id a246f326d86ec7996b78c5b3770a65e07a09129f8f53b7fa77af5766bde34c18
Jul 16 22:05:04.701569 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.701542    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:05:04.701622 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.701606    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:05:04.701657 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:04.701632    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:05:05.289631 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:05.289594    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz" event={"ID":"9a9aa79e-d315-4d92-a204-f0631d9d1018","Type":"ContainerStarted","Data":"092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700"}
Jul 16 22:05:05.290144 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:05.289645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz" event={"ID":"9a9aa79e-d315-4d92-a204-f0631d9d1018","Type":"ContainerStarted","Data":"a246f326d86ec7996b78c5b3770a65e07a09129f8f53b7fa77af5766bde34c18"}
Jul 16 22:05:05.311955 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:05.311903    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz" podStartSLOduration=1.311889889 podStartE2EDuration="1.311889889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:05:05.309806667 +0000 UTC m=+1570.135451979" watchObservedRunningTime="2026-07-16 22:05:05.311889889 +0000 UTC m=+1570.137535188"
Jul 16 22:05:05.562532 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:05.562461    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:05.567312 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:05.567289    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:06.295037 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:06.295006    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:06.296060 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:06.296043    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:08.288998 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:08.288966    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:05:16.475929 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.475902    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"]
Jul 16 22:05:16.476345 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.476123    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz" podUID="9a9aa79e-d315-4d92-a204-f0631d9d1018" containerName="istio-proxy" containerID="cri-o://092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700" gracePeriod=30
Jul 16 22:05:16.614668 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.614644    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:16.704741 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.704705    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r92tj\" (UniqueName: \"kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-kube-api-access-r92tj\") pod \"9a9aa79e-d315-4d92-a204-f0631d9d1018\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") "
Jul 16 22:05:16.704877 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.704774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-podinfo\") pod \"9a9aa79e-d315-4d92-a204-f0631d9d1018\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") "
Jul 16 22:05:16.704877 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.704814    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-envoy\") pod \"9a9aa79e-d315-4d92-a204-f0631d9d1018\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") "
Jul 16 22:05:16.705024 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705002    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9aa79e-d315-4d92-a204-f0631d9d1018-istiod-ca-cert\") pod \"9a9aa79e-d315-4d92-a204-f0631d9d1018\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") "
Jul 16 22:05:16.705088 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705047    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-token\") pod \"9a9aa79e-d315-4d92-a204-f0631d9d1018\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") "
Jul 16 22:05:16.705141 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705091    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-credential-socket\") pod \"9a9aa79e-d315-4d92-a204-f0631d9d1018\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") "
Jul 16 22:05:16.705141 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705127    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-data\") pod \"9a9aa79e-d315-4d92-a204-f0631d9d1018\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") "
Jul 16 22:05:16.705238 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705157    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-certs\") pod \"9a9aa79e-d315-4d92-a204-f0631d9d1018\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") "
Jul 16 22:05:16.705238 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705217    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-socket\") pod \"9a9aa79e-d315-4d92-a204-f0631d9d1018\" (UID: \"9a9aa79e-d315-4d92-a204-f0631d9d1018\") "
Jul 16 22:05:16.705364 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705339    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a9aa79e-d315-4d92-a204-f0631d9d1018-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a9aa79e-d315-4d92-a204-f0631d9d1018" (UID: "9a9aa79e-d315-4d92-a204-f0631d9d1018"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:05:16.705415 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705359    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a9aa79e-d315-4d92-a204-f0631d9d1018" (UID: "9a9aa79e-d315-4d92-a204-f0631d9d1018"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:16.705515 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705499    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a9aa79e-d315-4d92-a204-f0631d9d1018-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:16.705570 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705522    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:16.705570 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705528    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a9aa79e-d315-4d92-a204-f0631d9d1018" (UID: "9a9aa79e-d315-4d92-a204-f0631d9d1018"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:16.705757 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.705736    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a9aa79e-d315-4d92-a204-f0631d9d1018" (UID: "9a9aa79e-d315-4d92-a204-f0631d9d1018"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:16.706171 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.706136    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a9aa79e-d315-4d92-a204-f0631d9d1018" (UID: "9a9aa79e-d315-4d92-a204-f0631d9d1018"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:16.707058 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.707035    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a9aa79e-d315-4d92-a204-f0631d9d1018" (UID: "9a9aa79e-d315-4d92-a204-f0631d9d1018"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:16.707058 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.707040    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-kube-api-access-r92tj" (OuterVolumeSpecName: "kube-api-access-r92tj") pod "9a9aa79e-d315-4d92-a204-f0631d9d1018" (UID: "9a9aa79e-d315-4d92-a204-f0631d9d1018"). InnerVolumeSpecName "kube-api-access-r92tj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:05:16.707244 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.707226    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a9aa79e-d315-4d92-a204-f0631d9d1018" (UID: "9a9aa79e-d315-4d92-a204-f0631d9d1018"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:05:16.707558 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.707535    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a9aa79e-d315-4d92-a204-f0631d9d1018" (UID: "9a9aa79e-d315-4d92-a204-f0631d9d1018"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:05:16.806793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.806754    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:16.806793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.806789    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:16.806793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.806801    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:16.807049 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.806812    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:16.807049 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.806823    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a9aa79e-d315-4d92-a204-f0631d9d1018-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:16.807049 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.806833    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r92tj\" (UniqueName: \"kubernetes.io/projected/9a9aa79e-d315-4d92-a204-f0631d9d1018-kube-api-access-r92tj\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:16.807049 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:16.806845    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a9aa79e-d315-4d92-a204-f0631d9d1018-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:17.356849 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:17.356814    2563 generic.go:356] "Generic (PLEG): container finished" podID="9a9aa79e-d315-4d92-a204-f0631d9d1018" containerID="092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700" exitCode=0
Jul 16 22:05:17.357040 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:17.356847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz" event={"ID":"9a9aa79e-d315-4d92-a204-f0631d9d1018","Type":"ContainerDied","Data":"092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700"}
Jul 16 22:05:17.357040 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:17.356860    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"
Jul 16 22:05:17.357040 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:17.356904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz" event={"ID":"9a9aa79e-d315-4d92-a204-f0631d9d1018","Type":"ContainerDied","Data":"a246f326d86ec7996b78c5b3770a65e07a09129f8f53b7fa77af5766bde34c18"}
Jul 16 22:05:17.357040 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:17.356926    2563 scope.go:117] "RemoveContainer" containerID="092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700"
Jul 16 22:05:17.366212 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:17.366197    2563 scope.go:117] "RemoveContainer" containerID="092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700"
Jul 16 22:05:17.366460 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:05:17.366440    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700\": container with ID starting with 092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700 not found: ID does not exist" containerID="092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700"
Jul 16 22:05:17.366520 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:17.366471    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700"} err="failed to get container status \"092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700\": rpc error: code = NotFound desc = could not find container \"092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700\": container with ID starting with 092ac8e198b88da155b27a197400beabf708e22c3b28b4cadb2d5e15f69b7700 not found: ID does not exist"
Jul 16 22:05:17.378362 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:17.378339    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"]
Jul 16 22:05:17.383408 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:17.383390    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9bc14df8-openshift-default-6d7765749-r9mhz"]
Jul 16 22:05:17.673978 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:17.673886    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a9aa79e-d315-4d92-a204-f0631d9d1018" path="/var/lib/kubelet/pods/9a9aa79e-d315-4d92-a204-f0631d9d1018/volumes"
Jul 16 22:05:18.694716 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:18.694679    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:05:22.614337 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.614306    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"]
Jul 16 22:05:22.614656 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.614642    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9aa79e-d315-4d92-a204-f0631d9d1018" containerName="istio-proxy"
Jul 16 22:05:22.614656 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.614653    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9aa79e-d315-4d92-a204-f0631d9d1018" containerName="istio-proxy"
Jul 16 22:05:22.614721 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.614712    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9aa79e-d315-4d92-a204-f0631d9d1018" containerName="istio-proxy"
Jul 16 22:05:22.617430 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.617413    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.620232 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.620216    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-257d589c-openshift-default-dockercfg-nc6hd\""
Jul 16 22:05:22.642471 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.642445    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"]
Jul 16 22:05:22.758615 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.758581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istiod-ca-cert\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.758785 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.758644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-podinfo\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.758785 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.758714    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-certs\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.759216 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.758787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74hqr\" (UniqueName: \"kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-kube-api-access-74hqr\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.759216 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.758818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-token\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.759216 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.758855    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-credential-socket\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.759216 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.758875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-data\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.759216 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.758917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-socket\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.759216 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.758961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-envoy\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.859766 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.859690    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istiod-ca-cert\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.859766 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.859747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-podinfo\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860004 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.859781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-certs\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860004 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.859825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74hqr\" (UniqueName: \"kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-kube-api-access-74hqr\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860004 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.859851    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-token\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860004 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.859909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-credential-socket\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860004 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.859962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-data\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860004 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.859994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-socket\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860346 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.860018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-envoy\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860474 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.860421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-data\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860593 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.860488    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-credential-socket\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860593 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.860566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-socket\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860700 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.860593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-certs\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.860700 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.860593    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istiod-ca-cert\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.862333 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.862305    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-envoy\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.862608 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.862579    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-podinfo\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.868764 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.868739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-token\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.869101 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.869085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74hqr\" (UniqueName: \"kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-kube-api-access-74hqr\") pod \"e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") " pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:22.926715 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:22.926666    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:23.062576 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:23.062553    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"]
Jul 16 22:05:23.064589 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:05:23.064560    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625d21dc_c7fc_43de_af2e_4e63cfce7e83.slice/crio-d2e98df2ad6d58d55535bec699e0ad6fd9fc39c33ee9fd4b5470b40e677fea20 WatchSource:0}: Error finding container d2e98df2ad6d58d55535bec699e0ad6fd9fc39c33ee9fd4b5470b40e677fea20: Status 404 returned error can't find the container with id d2e98df2ad6d58d55535bec699e0ad6fd9fc39c33ee9fd4b5470b40e677fea20
Jul 16 22:05:23.066851 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:23.066817    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:05:23.067023 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:23.066897    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:05:23.067023 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:23.066997    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:05:23.388499 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:23.388405    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp" event={"ID":"625d21dc-c7fc-43de-af2e-4e63cfce7e83","Type":"ContainerStarted","Data":"34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905"}
Jul 16 22:05:23.388499 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:23.388457    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp" event={"ID":"625d21dc-c7fc-43de-af2e-4e63cfce7e83","Type":"ContainerStarted","Data":"d2e98df2ad6d58d55535bec699e0ad6fd9fc39c33ee9fd4b5470b40e677fea20"}
Jul 16 22:05:23.408521 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:23.408474    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp" podStartSLOduration=1.408460279 podStartE2EDuration="1.408460279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:05:23.406585395 +0000 UTC m=+1588.232230694" watchObservedRunningTime="2026-07-16 22:05:23.408460279 +0000 UTC m=+1588.234105652"
Jul 16 22:05:23.927209 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:23.927175    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:24.932015 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:24.931978    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:25.399139 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:25.399062    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:25.400106 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:25.400091    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:28.341172 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:28.341128    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"]
Jul 16 22:05:28.414050 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:28.414007    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp" podUID="625d21dc-c7fc-43de-af2e-4e63cfce7e83" containerName="istio-proxy" containerID="cri-o://34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905" gracePeriod=30
Jul 16 22:05:33.861916 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.861890    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:33.957155 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957129    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-podinfo\") pod \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") "
Jul 16 22:05:33.957354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957167    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-envoy\") pod \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") "
Jul 16 22:05:33.957354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957185    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74hqr\" (UniqueName: \"kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-kube-api-access-74hqr\") pod \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") "
Jul 16 22:05:33.957354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957208    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-token\") pod \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") "
Jul 16 22:05:33.957354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957231    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-credential-socket\") pod \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") "
Jul 16 22:05:33.957354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957258    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-socket\") pod \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") "
Jul 16 22:05:33.957354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957323    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-certs\") pod \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") "
Jul 16 22:05:33.957354 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957352    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-data\") pod \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") "
Jul 16 22:05:33.957787 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957404    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istiod-ca-cert\") pod \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\" (UID: \"625d21dc-c7fc-43de-af2e-4e63cfce7e83\") "
Jul 16 22:05:33.957787 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957534    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "625d21dc-c7fc-43de-af2e-4e63cfce7e83" (UID: "625d21dc-c7fc-43de-af2e-4e63cfce7e83"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:33.957787 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957572    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "625d21dc-c7fc-43de-af2e-4e63cfce7e83" (UID: "625d21dc-c7fc-43de-af2e-4e63cfce7e83"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:33.957787 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957645    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "625d21dc-c7fc-43de-af2e-4e63cfce7e83" (UID: "625d21dc-c7fc-43de-af2e-4e63cfce7e83"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:33.957787 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957776    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:33.958093 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957796    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:33.958093 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957811    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:33.958093 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.957857    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "625d21dc-c7fc-43de-af2e-4e63cfce7e83" (UID: "625d21dc-c7fc-43de-af2e-4e63cfce7e83"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:05:33.958585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.958558    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-data" (OuterVolumeSpecName: "istio-data") pod "625d21dc-c7fc-43de-af2e-4e63cfce7e83" (UID: "625d21dc-c7fc-43de-af2e-4e63cfce7e83"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:33.959624 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.959599    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-kube-api-access-74hqr" (OuterVolumeSpecName: "kube-api-access-74hqr") pod "625d21dc-c7fc-43de-af2e-4e63cfce7e83" (UID: "625d21dc-c7fc-43de-af2e-4e63cfce7e83"). InnerVolumeSpecName "kube-api-access-74hqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:05:33.959624 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.959611    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "625d21dc-c7fc-43de-af2e-4e63cfce7e83" (UID: "625d21dc-c7fc-43de-af2e-4e63cfce7e83"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:05:33.959785 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.959671    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "625d21dc-c7fc-43de-af2e-4e63cfce7e83" (UID: "625d21dc-c7fc-43de-af2e-4e63cfce7e83"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:05:33.959829 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:33.959806    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-token" (OuterVolumeSpecName: "istio-token") pod "625d21dc-c7fc-43de-af2e-4e63cfce7e83" (UID: "625d21dc-c7fc-43de-af2e-4e63cfce7e83"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:05:34.058375 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.058331    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:34.058375 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.058371    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:34.058375 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.058379    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74hqr\" (UniqueName: \"kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-kube-api-access-74hqr\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:34.058375 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.058388    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:34.058375 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.058396    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:34.058663 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.058404    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/625d21dc-c7fc-43de-af2e-4e63cfce7e83-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:05:34.446103 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.446075    2563 generic.go:356] "Generic (PLEG): container finished" podID="625d21dc-c7fc-43de-af2e-4e63cfce7e83" containerID="34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905" exitCode=0
Jul 16 22:05:34.446341 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.446126    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"
Jul 16 22:05:34.446341 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.446159    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp" event={"ID":"625d21dc-c7fc-43de-af2e-4e63cfce7e83","Type":"ContainerDied","Data":"34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905"}
Jul 16 22:05:34.446341 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.446211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp" event={"ID":"625d21dc-c7fc-43de-af2e-4e63cfce7e83","Type":"ContainerDied","Data":"d2e98df2ad6d58d55535bec699e0ad6fd9fc39c33ee9fd4b5470b40e677fea20"}
Jul 16 22:05:34.446341 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.446235    2563 scope.go:117] "RemoveContainer" containerID="34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905"
Jul 16 22:05:34.458607 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.458590    2563 scope.go:117] "RemoveContainer" containerID="34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905"
Jul 16 22:05:34.458872 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:05:34.458854    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905\": container with ID starting with 34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905 not found: ID does not exist" containerID="34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905"
Jul 16 22:05:34.458919 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.458882    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905"} err="failed to get container status \"34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905\": rpc error: code = NotFound desc = could not find container \"34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905\": container with ID starting with 34ffe5ca12ef4cbf76f4af4375e661923aef9a5acb18f7c320311684e391b905 not found: ID does not exist"
Jul 16 22:05:34.470545 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.470520    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"]
Jul 16 22:05:34.477073 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:34.477053    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-257d589c-openshift-default-84789b5f59-hsmdp"]
Jul 16 22:05:35.673904 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:05:35.673860    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="625d21dc-c7fc-43de-af2e-4e63cfce7e83" path="/var/lib/kubelet/pods/625d21dc-c7fc-43de-af2e-4e63cfce7e83/volumes"
Jul 16 22:06:57.721053 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:06:57.721023    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:07:07.390380 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:07.390343    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:07:10.009432 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.009399    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"]
Jul 16 22:07:10.009925 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.009905    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625d21dc-c7fc-43de-af2e-4e63cfce7e83" containerName="istio-proxy"
Jul 16 22:07:10.010037 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.009928    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="625d21dc-c7fc-43de-af2e-4e63cfce7e83" containerName="istio-proxy"
Jul 16 22:07:10.010091 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.010053    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="625d21dc-c7fc-43de-af2e-4e63cfce7e83" containerName="istio-proxy"
Jul 16 22:07:10.011999 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.011981    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.014582 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.014564    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f76fb58a-openshift-default-dockercfg-n8bsk\""
Jul 16 22:07:10.036021 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.036000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"]
Jul 16 22:07:10.164610 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.164576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a89bebc9-a108-43c4-8350-0c190769c2fd-istiod-ca-cert\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.164777 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.164619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-data\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.164777 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.164637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-envoy\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.164777 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.164685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-certs\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.164777 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.164706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-podinfo\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.164777 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.164723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-socket\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.165021 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.164802    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-token\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.165021 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.164833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz5cg\" (UniqueName: \"kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-kube-api-access-kz5cg\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.165021 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.164890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-credential-socket\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266318 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-token\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266318 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266277    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz5cg\" (UniqueName: \"kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-kube-api-access-kz5cg\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266318 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266308    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-credential-socket\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266551 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a89bebc9-a108-43c4-8350-0c190769c2fd-istiod-ca-cert\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266551 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-data\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266551 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-envoy\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266551 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-certs\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266551 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-podinfo\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266551 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266528    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-socket\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266881 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-credential-socket\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266958 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266872    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-data\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.266958 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.266921    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-socket\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.267038 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.267020    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-certs\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.267188 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.267169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a89bebc9-a108-43c4-8350-0c190769c2fd-istiod-ca-cert\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.268895 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.268873    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-envoy\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.269127 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.269110    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-podinfo\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.274591 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.274570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz5cg\" (UniqueName: \"kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-kube-api-access-kz5cg\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.274691 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.274571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-token\") pod \"e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") " pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.322333 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.322305    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:10.463700 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.463676    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"]
Jul 16 22:07:10.465646 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:07:10.465615    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89bebc9_a108_43c4_8350_0c190769c2fd.slice/crio-368e3067e541631a238da14f63369ecb7d8ec24dfaed84d3f72a075bbfda435e WatchSource:0}: Error finding container 368e3067e541631a238da14f63369ecb7d8ec24dfaed84d3f72a075bbfda435e: Status 404 returned error can't find the container with id 368e3067e541631a238da14f63369ecb7d8ec24dfaed84d3f72a075bbfda435e
Jul 16 22:07:10.467842 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.467805    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:07:10.467969 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.467889    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:07:10.467969 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.467955    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:07:10.934126 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.934097    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" event={"ID":"a89bebc9-a108-43c4-8350-0c190769c2fd","Type":"ContainerStarted","Data":"e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49"}
Jul 16 22:07:10.934279 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.934145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" event={"ID":"a89bebc9-a108-43c4-8350-0c190769c2fd","Type":"ContainerStarted","Data":"368e3067e541631a238da14f63369ecb7d8ec24dfaed84d3f72a075bbfda435e"}
Jul 16 22:07:10.978390 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:10.978333    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" podStartSLOduration=1.978317953 podStartE2EDuration="1.978317953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:07:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:07:10.975344022 +0000 UTC m=+1695.800989321" watchObservedRunningTime="2026-07-16 22:07:10.978317953 +0000 UTC m=+1695.803963250"
Jul 16 22:07:11.322667 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:11.322594    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:11.327361 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:11.327337    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:11.940079 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:11.940050    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:11.941012 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:11.940992    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:18.712484 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:18.712277    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:07:26.941371 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:26.941337    2563 patch_prober.go:28] interesting pod/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 16 22:07:26.941794 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:26.941405    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 16 22:07:27.022301 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:27.022268    2563 generic.go:356] "Generic (PLEG): container finished" podID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerID="e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49" exitCode=0
Jul 16 22:07:27.022461 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:27.022346    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" event={"ID":"a89bebc9-a108-43c4-8350-0c190769c2fd","Type":"ContainerDied","Data":"e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49"}
Jul 16 22:07:27.022753 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:27.022738    2563 scope.go:117] "RemoveContainer" containerID="e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49"
Jul 16 22:07:27.023718 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:27.023689    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:07:27.023796 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:27.023778    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:07:27.023836 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:27.023824    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:07:28.031747 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:28.031709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" event={"ID":"a89bebc9-a108-43c4-8350-0c190769c2fd","Type":"ContainerStarted","Data":"2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc"}
Jul 16 22:07:28.323049 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:28.322933    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:28.323202 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:28.323168    2563 patch_prober.go:28] interesting pod/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 16 22:07:28.323257 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:28.323220    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 16 22:07:29.322824 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:29.322788    2563 patch_prober.go:28] interesting pod/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 16 22:07:29.323317 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:29.322841    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 16 22:07:30.005738 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:30.005703    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:07:30.323402 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:30.323323    2563 patch_prober.go:28] interesting pod/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 16 22:07:30.323402 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:30.323372    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 16 22:07:31.322917 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:31.322885    2563 patch_prober.go:28] interesting pod/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Jul 16 22:07:31.323101 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:31.322961    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Jul 16 22:07:32.327361 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:32.327333    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:32.327848 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:32.327720    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:32.328312 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:32.328294    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:32.443304 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:32.443274    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"]
Jul 16 22:07:33.062779 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:33.062738    2563 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" secret="" err="secret \"e2e-mt-f76fb58a-openshift-default-dockercfg-n8bsk\" not found"
Jul 16 22:07:34.067964 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:34.067886    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy" containerID="cri-o://2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc" gracePeriod=30
Jul 16 22:07:39.323701 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.323678    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:39.424601 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424519    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-certs\") pod \"a89bebc9-a108-43c4-8350-0c190769c2fd\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") "
Jul 16 22:07:39.424601 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424575    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-data\") pod \"a89bebc9-a108-43c4-8350-0c190769c2fd\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") "
Jul 16 22:07:39.424601 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424602    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-envoy\") pod \"a89bebc9-a108-43c4-8350-0c190769c2fd\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") "
Jul 16 22:07:39.424867 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-socket\") pod \"a89bebc9-a108-43c4-8350-0c190769c2fd\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") "
Jul 16 22:07:39.424867 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424661    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-credential-socket\") pod \"a89bebc9-a108-43c4-8350-0c190769c2fd\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") "
Jul 16 22:07:39.424867 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424694    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-podinfo\") pod \"a89bebc9-a108-43c4-8350-0c190769c2fd\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") "
Jul 16 22:07:39.424867 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424758    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz5cg\" (UniqueName: \"kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-kube-api-access-kz5cg\") pod \"a89bebc9-a108-43c4-8350-0c190769c2fd\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") "
Jul 16 22:07:39.424867 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424818    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-token\") pod \"a89bebc9-a108-43c4-8350-0c190769c2fd\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") "
Jul 16 22:07:39.424867 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424793    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a89bebc9-a108-43c4-8350-0c190769c2fd" (UID: "a89bebc9-a108-43c4-8350-0c190769c2fd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:07:39.425184 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424874    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a89bebc9-a108-43c4-8350-0c190769c2fd-istiod-ca-cert\") pod \"a89bebc9-a108-43c4-8350-0c190769c2fd\" (UID: \"a89bebc9-a108-43c4-8350-0c190769c2fd\") "
Jul 16 22:07:39.425184 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.424896    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a89bebc9-a108-43c4-8350-0c190769c2fd" (UID: "a89bebc9-a108-43c4-8350-0c190769c2fd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:07:39.425184 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.425076    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a89bebc9-a108-43c4-8350-0c190769c2fd" (UID: "a89bebc9-a108-43c4-8350-0c190769c2fd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:07:39.425349 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.425201    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:07:39.425349 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.425218    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:07:39.425349 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.425231    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:07:39.425506 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.425404    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a89bebc9-a108-43c4-8350-0c190769c2fd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a89bebc9-a108-43c4-8350-0c190769c2fd" (UID: "a89bebc9-a108-43c4-8350-0c190769c2fd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:07:39.425734 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.425707    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-data" (OuterVolumeSpecName: "istio-data") pod "a89bebc9-a108-43c4-8350-0c190769c2fd" (UID: "a89bebc9-a108-43c4-8350-0c190769c2fd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:07:39.426978 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.426929    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a89bebc9-a108-43c4-8350-0c190769c2fd" (UID: "a89bebc9-a108-43c4-8350-0c190769c2fd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:07:39.426978 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.426960    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a89bebc9-a108-43c4-8350-0c190769c2fd" (UID: "a89bebc9-a108-43c4-8350-0c190769c2fd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:07:39.427510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.427486    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-token" (OuterVolumeSpecName: "istio-token") pod "a89bebc9-a108-43c4-8350-0c190769c2fd" (UID: "a89bebc9-a108-43c4-8350-0c190769c2fd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:07:39.427510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.427498    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-kube-api-access-kz5cg" (OuterVolumeSpecName: "kube-api-access-kz5cg") pod "a89bebc9-a108-43c4-8350-0c190769c2fd" (UID: "a89bebc9-a108-43c4-8350-0c190769c2fd"). InnerVolumeSpecName "kube-api-access-kz5cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:07:39.525964 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.525911    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:07:39.525964 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.525933    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:07:39.525964 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.525963    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:07:39.525964 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.525972    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz5cg\" (UniqueName: \"kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-kube-api-access-kz5cg\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:07:39.526215 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.525981    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a89bebc9-a108-43c4-8350-0c190769c2fd-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:07:39.526215 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:39.525989    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a89bebc9-a108-43c4-8350-0c190769c2fd-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:07:40.097469 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.097432    2563 generic.go:356] "Generic (PLEG): container finished" podID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerID="2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc" exitCode=0
Jul 16 22:07:40.097642 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.097481    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"
Jul 16 22:07:40.097642 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.097486    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" event={"ID":"a89bebc9-a108-43c4-8350-0c190769c2fd","Type":"ContainerDied","Data":"2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc"}
Jul 16 22:07:40.097642 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.097535    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf" event={"ID":"a89bebc9-a108-43c4-8350-0c190769c2fd","Type":"ContainerDied","Data":"368e3067e541631a238da14f63369ecb7d8ec24dfaed84d3f72a075bbfda435e"}
Jul 16 22:07:40.097642 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.097558    2563 scope.go:117] "RemoveContainer" containerID="2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc"
Jul 16 22:07:40.107195 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.107166    2563 scope.go:117] "RemoveContainer" containerID="e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49"
Jul 16 22:07:40.115417 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.115399    2563 scope.go:117] "RemoveContainer" containerID="2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc"
Jul 16 22:07:40.115655 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:07:40.115635    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc\": container with ID starting with 2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc not found: ID does not exist" containerID="2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc"
Jul 16 22:07:40.115712 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.115663    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc"} err="failed to get container status \"2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc\": rpc error: code = NotFound desc = could not find container \"2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc\": container with ID starting with 2eb16bf80443c444b5f6230f6f629ef9821ffd07e99fdfb85b9cb34b98bffffc not found: ID does not exist"
Jul 16 22:07:40.115712 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.115680    2563 scope.go:117] "RemoveContainer" containerID="e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49"
Jul 16 22:07:40.115962 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:07:40.115927    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49\": container with ID starting with e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49 not found: ID does not exist" containerID="e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49"
Jul 16 22:07:40.116024 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.115967    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49"} err="failed to get container status \"e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49\": rpc error: code = NotFound desc = could not find container \"e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49\": container with ID starting with e97300459ddf18bee1afdb9508e19a49857c1c7a007ec48b1d5caf76fdd8dd49 not found: ID does not exist"
Jul 16 22:07:40.119242 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.119222    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"]
Jul 16 22:07:40.125256 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:40.125238    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f76fb58a-openshift-default-588b445679-b8zqf"]
Jul 16 22:07:41.673822 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:41.673791    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" path="/var/lib/kubelet/pods/a89bebc9-a108-43c4-8350-0c190769c2fd/volumes"
Jul 16 22:07:52.608385 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.608350    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"]
Jul 16 22:07:52.608875 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.608860    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy"
Jul 16 22:07:52.608919 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.608880    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy"
Jul 16 22:07:52.608919 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.608908    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy"
Jul 16 22:07:52.608919 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.608917    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy"
Jul 16 22:07:52.609050 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.609018    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy"
Jul 16 22:07:52.609050 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.609029    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a89bebc9-a108-43c4-8350-0c190769c2fd" containerName="istio-proxy"
Jul 16 22:07:52.612704 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.612684    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.615262 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.615243    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-910fadad-openshift-default-dockercfg-cxpw8\""
Jul 16 22:07:52.624186 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.624164    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"]
Jul 16 22:07:52.731470 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.731430    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-data\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.731655 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.731493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-podinfo\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.731655 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.731526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-socket\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.731655 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.731545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-envoy\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.731655 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.731623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-credential-socket\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.731872 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.731687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istiod-ca-cert\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.731872 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.731726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-certs\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.731872 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.731758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-token\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.731872 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.731798    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bthpb\" (UniqueName: \"kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-kube-api-access-bthpb\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.832954 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.832897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-data\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833130 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.832965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-podinfo\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833130 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.832988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-socket\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833130 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.833005    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-envoy\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833130 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.833029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-credential-socket\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833130 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.833057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istiod-ca-cert\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833130 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.833092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-certs\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833515 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.833493    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-credential-socket\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833578 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.833521    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-token\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833578 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.833427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-data\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833578 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.833531    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-socket\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833578 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.833457    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-certs\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.833578 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.833551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bthpb\" (UniqueName: \"kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-kube-api-access-bthpb\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.834052 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.834026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istiod-ca-cert\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.835991 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.835967    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-envoy\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.836175 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.836154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-podinfo\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.841745 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.841722    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bthpb\" (UniqueName: \"kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-kube-api-access-bthpb\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.842123 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.842104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-token\") pod \"e2e-mt-910fadad-openshift-default-844654947f-xt7cl\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") " pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:52.926381 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:52.926295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:53.063205 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:53.063181    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"]
Jul 16 22:07:53.065257 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:07:53.065228    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7aa205_6329_40e5_9ff3_d4b46463ed1d.slice/crio-58430ec81ad20f3735f69c6e3f7145f1fb5ba0faa2f30392667af64e725fedd8 WatchSource:0}: Error finding container 58430ec81ad20f3735f69c6e3f7145f1fb5ba0faa2f30392667af64e725fedd8: Status 404 returned error can't find the container with id 58430ec81ad20f3735f69c6e3f7145f1fb5ba0faa2f30392667af64e725fedd8
Jul 16 22:07:53.067406 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:53.067373    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:07:53.067478 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:53.067440    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:07:53.067478 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:53.067469    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:07:53.171055 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:53.171014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" event={"ID":"0c7aa205-6329-40e5-9ff3-d4b46463ed1d","Type":"ContainerStarted","Data":"10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b"}
Jul 16 22:07:53.171234 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:53.171081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" event={"ID":"0c7aa205-6329-40e5-9ff3-d4b46463ed1d","Type":"ContainerStarted","Data":"58430ec81ad20f3735f69c6e3f7145f1fb5ba0faa2f30392667af64e725fedd8"}
Jul 16 22:07:53.196530 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:53.196481    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" podStartSLOduration=1.196461993 podStartE2EDuration="1.196461993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:07:53.195915063 +0000 UTC m=+1738.021560403" watchObservedRunningTime="2026-07-16 22:07:53.196461993 +0000 UTC m=+1738.022107295"
Jul 16 22:07:53.927077 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:53.927052    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:54.932112 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:54.932080    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:55.180892 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:55.180864    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:07:55.181740 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:07:55.181717    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:08:02.786435 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:02.786401    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:08:08.683852 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.683811    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"]
Jul 16 22:08:08.687836 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.687748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.690685 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.690655    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-910fadad\"/\"openshift-service-ca.crt\""
Jul 16 22:08:08.690985 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.690965    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-910fadad\"/\"default-dockercfg-6s5nq\""
Jul 16 22:08:08.691582 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.691560    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-910fadad\"/\"kube-root-ca.crt\""
Jul 16 22:08:08.691853 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.691837    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-910fadad\"/\"e2e-lifecycle-model-910fadad-kserve-self-signed-certs\""
Jul 16 22:08:08.698633 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.698611    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"]
Jul 16 22:08:08.768517 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.768481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-dshm\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.768718 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.768529    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-home\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.768718 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.768618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9566\" (UniqueName: \"kubernetes.io/projected/fb41666f-8fe7-4d33-9651-06781529a9bc-kube-api-access-w9566\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.768718 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.768653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-tmp-dir\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.768872 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.768725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb41666f-8fe7-4d33-9651-06781529a9bc-tls-certs\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.768872 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.768751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-model-cache\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.870301 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.870255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9566\" (UniqueName: \"kubernetes.io/projected/fb41666f-8fe7-4d33-9651-06781529a9bc-kube-api-access-w9566\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.870505 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.870313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-tmp-dir\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.870505 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.870369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb41666f-8fe7-4d33-9651-06781529a9bc-tls-certs\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.870505 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.870403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-model-cache\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.870505 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.870439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-dshm\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.870505 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.870478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-home\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.871537 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.871100    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-model-cache\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.871537 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.871368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-home\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.871537 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.871507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-tmp-dir\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.873482 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.873454    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-dshm\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.874124 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.874097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb41666f-8fe7-4d33-9651-06781529a9bc-tls-certs\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.880393 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.880367    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9566\" (UniqueName: \"kubernetes.io/projected/fb41666f-8fe7-4d33-9651-06781529a9bc-kube-api-access-w9566\") pod \"e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") " pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:08.999147 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:08.999069    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:09.150987 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:09.150960    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"]
Jul 16 22:08:09.153074 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:08:09.153050    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb41666f_8fe7_4d33_9651_06781529a9bc.slice/crio-a938f940d110a22f0d59dbb921ef04bb1e8d165727409eb704ded0600f30eeec WatchSource:0}: Error finding container a938f940d110a22f0d59dbb921ef04bb1e8d165727409eb704ded0600f30eeec: Status 404 returned error can't find the container with id a938f940d110a22f0d59dbb921ef04bb1e8d165727409eb704ded0600f30eeec
Jul 16 22:08:09.264305 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:09.264226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd" event={"ID":"fb41666f-8fe7-4d33-9651-06781529a9bc","Type":"ContainerStarted","Data":"5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff"}
Jul 16 22:08:09.264305 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:09.264267    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd" event={"ID":"fb41666f-8fe7-4d33-9651-06781529a9bc","Type":"ContainerStarted","Data":"a938f940d110a22f0d59dbb921ef04bb1e8d165727409eb704ded0600f30eeec"}
Jul 16 22:08:09.286925 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:09.286881    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd" podStartSLOduration=1.2868664459999999 podStartE2EDuration="1.286866446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:08:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:08:09.286023311 +0000 UTC m=+1754.111668624" watchObservedRunningTime="2026-07-16 22:08:09.286866446 +0000 UTC m=+1754.112511745"
Jul 16 22:08:10.230099 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:10.230060    2563 patch_prober.go:28] interesting pod/e2e-mt-910fadad-openshift-default-844654947f-xt7cl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:36864->10.133.0.47:15021: read: connection reset by peer" start-of-body=
Jul 16 22:08:10.230500 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:10.230121    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:36864->10.133.0.47:15021: read: connection reset by peer"
Jul 16 22:08:10.271086 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:10.271057    2563 generic.go:356] "Generic (PLEG): container finished" podID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerID="10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b" exitCode=0
Jul 16 22:08:10.271202 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:10.271125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" event={"ID":"0c7aa205-6329-40e5-9ff3-d4b46463ed1d","Type":"ContainerDied","Data":"10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b"}
Jul 16 22:08:10.271618 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:10.271604    2563 scope.go:117] "RemoveContainer" containerID="10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b"
Jul 16 22:08:10.272635 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:10.272606    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:08:10.272725 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:10.272671    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:08:10.272725 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:10.272709    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:08:11.278255 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:11.278221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" event={"ID":"0c7aa205-6329-40e5-9ff3-d4b46463ed1d","Type":"ContainerStarted","Data":"70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc"}
Jul 16 22:08:11.786674 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:11.786627    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:08:11.926726 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:11.926632    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:08:11.927241 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:11.927217    2563 patch_prober.go:28] interesting pod/e2e-mt-910fadad-openshift-default-844654947f-xt7cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 16 22:08:11.927457 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:11.927434    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 16 22:08:12.927747 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:12.927704    2563 patch_prober.go:28] interesting pod/e2e-mt-910fadad-openshift-default-844654947f-xt7cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 16 22:08:12.928257 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:12.927769    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 16 22:08:13.927591 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:13.927549    2563 patch_prober.go:28] interesting pod/e2e-mt-910fadad-openshift-default-844654947f-xt7cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 16 22:08:13.927793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:13.927613    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 16 22:08:14.927838 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:14.927361    2563 patch_prober.go:28] interesting pod/e2e-mt-910fadad-openshift-default-844654947f-xt7cl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 16 22:08:14.927838 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:14.927427    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 16 22:08:15.979749 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:15.979721    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:08:15.980223 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:15.980073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:08:15.981024 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:15.981006    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:08:19.000215 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:19.000169    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:19.000215 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:19.000223    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:19.012931 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:19.012906    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:19.333219 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:19.333142    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:23.788329 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:23.788291    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:08:36.582750 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:36.582713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:08:37.827782 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:37.827747    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"]
Jul 16 22:08:52.849050 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:52.848928    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd" podUID="fb41666f-8fe7-4d33-9651-06781529a9bc" containerName="main" containerID="cri-o://5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff" gracePeriod=45
Jul 16 22:08:53.100677 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.100616    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:53.171824 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.171791    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-dshm\") pod \"fb41666f-8fe7-4d33-9651-06781529a9bc\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") "
Jul 16 22:08:53.172014 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.171836    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb41666f-8fe7-4d33-9651-06781529a9bc-tls-certs\") pod \"fb41666f-8fe7-4d33-9651-06781529a9bc\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") "
Jul 16 22:08:53.172014 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.171879    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9566\" (UniqueName: \"kubernetes.io/projected/fb41666f-8fe7-4d33-9651-06781529a9bc-kube-api-access-w9566\") pod \"fb41666f-8fe7-4d33-9651-06781529a9bc\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") "
Jul 16 22:08:53.172014 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.171908    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-model-cache\") pod \"fb41666f-8fe7-4d33-9651-06781529a9bc\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") "
Jul 16 22:08:53.172014 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.171976    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-tmp-dir\") pod \"fb41666f-8fe7-4d33-9651-06781529a9bc\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") "
Jul 16 22:08:53.172249 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.172033    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-home\") pod \"fb41666f-8fe7-4d33-9651-06781529a9bc\" (UID: \"fb41666f-8fe7-4d33-9651-06781529a9bc\") "
Jul 16 22:08:53.172324 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.172292    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb41666f-8fe7-4d33-9651-06781529a9bc" (UID: "fb41666f-8fe7-4d33-9651-06781529a9bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:08:53.172377 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.172297    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb41666f-8fe7-4d33-9651-06781529a9bc" (UID: "fb41666f-8fe7-4d33-9651-06781529a9bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:08:53.172377 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.172354    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-home" (OuterVolumeSpecName: "home") pod "fb41666f-8fe7-4d33-9651-06781529a9bc" (UID: "fb41666f-8fe7-4d33-9651-06781529a9bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:08:53.174192 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.174169    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb41666f-8fe7-4d33-9651-06781529a9bc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb41666f-8fe7-4d33-9651-06781529a9bc" (UID: "fb41666f-8fe7-4d33-9651-06781529a9bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:08:53.174269 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.174189    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb41666f-8fe7-4d33-9651-06781529a9bc-kube-api-access-w9566" (OuterVolumeSpecName: "kube-api-access-w9566") pod "fb41666f-8fe7-4d33-9651-06781529a9bc" (UID: "fb41666f-8fe7-4d33-9651-06781529a9bc"). InnerVolumeSpecName "kube-api-access-w9566". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:08:53.174269 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.174206    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-dshm" (OuterVolumeSpecName: "dshm") pod "fb41666f-8fe7-4d33-9651-06781529a9bc" (UID: "fb41666f-8fe7-4d33-9651-06781529a9bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:08:53.272842 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.272812    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9566\" (UniqueName: \"kubernetes.io/projected/fb41666f-8fe7-4d33-9651-06781529a9bc-kube-api-access-w9566\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:08:53.272842 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.272837    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-model-cache\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:08:53.273058 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.272850    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-tmp-dir\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:08:53.273058 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.272861    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-home\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:08:53.273058 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.272870    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb41666f-8fe7-4d33-9651-06781529a9bc-dshm\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:08:53.273058 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.272879    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb41666f-8fe7-4d33-9651-06781529a9bc-tls-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:08:53.497412 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.497374    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb41666f-8fe7-4d33-9651-06781529a9bc" containerID="5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff" exitCode=0
Jul 16 22:08:53.497605 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.497429    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"
Jul 16 22:08:53.497605 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.497466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd" event={"ID":"fb41666f-8fe7-4d33-9651-06781529a9bc","Type":"ContainerDied","Data":"5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff"}
Jul 16 22:08:53.497605 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.497511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd" event={"ID":"fb41666f-8fe7-4d33-9651-06781529a9bc","Type":"ContainerDied","Data":"a938f940d110a22f0d59dbb921ef04bb1e8d165727409eb704ded0600f30eeec"}
Jul 16 22:08:53.497605 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.497530    2563 scope.go:117] "RemoveContainer" containerID="5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff"
Jul 16 22:08:53.507463 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.507445    2563 scope.go:117] "RemoveContainer" containerID="5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff"
Jul 16 22:08:53.507730 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:08:53.507698    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff\": container with ID starting with 5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff not found: ID does not exist" containerID="5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff"
Jul 16 22:08:53.507878 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.507723    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff"} err="failed to get container status \"5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff\": rpc error: code = NotFound desc = could not find container \"5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff\": container with ID starting with 5e4e526df8ee061c867071e12daa498db0d886819998d3341d61bda25b2822ff not found: ID does not exist"
Jul 16 22:08:53.517887 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.517864    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"]
Jul 16 22:08:53.523510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.523480    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-910fadad/e2e-lifecycle-model-910fadad-kserve-fb8468b7-q2gwd"]
Jul 16 22:08:53.673666 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:08:53.673635    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb41666f-8fe7-4d33-9651-06781529a9bc" path="/var/lib/kubelet/pods/fb41666f-8fe7-4d33-9651-06781529a9bc/volumes"
Jul 16 22:09:17.217156 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:17.217121    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:09:20.717790 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:20.717755    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"]
Jul 16 22:09:20.718285 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:20.718016    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy" containerID="cri-o://70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc" gracePeriod=30
Jul 16 22:09:25.974276 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:25.974251    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:09:26.052795 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.052710    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-credential-socket\") pod \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") "
Jul 16 22:09:26.052795 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.052746    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istiod-ca-cert\") pod \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") "
Jul 16 22:09:26.052795 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.052774    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-socket\") pod \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") "
Jul 16 22:09:26.053107 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.052811    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-certs\") pod \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") "
Jul 16 22:09:26.053107 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.052840    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-envoy\") pod \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") "
Jul 16 22:09:26.053107 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.052865    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-token\") pod \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") "
Jul 16 22:09:26.053107 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.052905    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-podinfo\") pod \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") "
Jul 16 22:09:26.053107 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.052994    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bthpb\" (UniqueName: \"kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-kube-api-access-bthpb\") pod \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") "
Jul 16 22:09:26.053107 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.053028    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-data\") pod \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\" (UID: \"0c7aa205-6329-40e5-9ff3-d4b46463ed1d\") "
Jul 16 22:09:26.053107 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.053074    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c7aa205-6329-40e5-9ff3-d4b46463ed1d" (UID: "0c7aa205-6329-40e5-9ff3-d4b46463ed1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:09:26.053107 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.053087    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c7aa205-6329-40e5-9ff3-d4b46463ed1d" (UID: "0c7aa205-6329-40e5-9ff3-d4b46463ed1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:09:26.053489 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.053273    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c7aa205-6329-40e5-9ff3-d4b46463ed1d" (UID: "0c7aa205-6329-40e5-9ff3-d4b46463ed1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:09:26.053489 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.053309    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c7aa205-6329-40e5-9ff3-d4b46463ed1d" (UID: "0c7aa205-6329-40e5-9ff3-d4b46463ed1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:09:26.053489 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.053370    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:09:26.053489 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.053389    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:09:26.053489 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.053404    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:09:26.053489 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.053419    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:09:26.054295 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.054267    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c7aa205-6329-40e5-9ff3-d4b46463ed1d" (UID: "0c7aa205-6329-40e5-9ff3-d4b46463ed1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:09:26.055338 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.055305    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c7aa205-6329-40e5-9ff3-d4b46463ed1d" (UID: "0c7aa205-6329-40e5-9ff3-d4b46463ed1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:09:26.055449 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.055385    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-kube-api-access-bthpb" (OuterVolumeSpecName: "kube-api-access-bthpb") pod "0c7aa205-6329-40e5-9ff3-d4b46463ed1d" (UID: "0c7aa205-6329-40e5-9ff3-d4b46463ed1d"). InnerVolumeSpecName "kube-api-access-bthpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:09:26.055449 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.055429    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c7aa205-6329-40e5-9ff3-d4b46463ed1d" (UID: "0c7aa205-6329-40e5-9ff3-d4b46463ed1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:09:26.055449 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.055437    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c7aa205-6329-40e5-9ff3-d4b46463ed1d" (UID: "0c7aa205-6329-40e5-9ff3-d4b46463ed1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:09:26.154517 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.154490    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bthpb\" (UniqueName: \"kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-kube-api-access-bthpb\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:09:26.154517 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.154513    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:09:26.154517 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.154522    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:09:26.154702 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.154530    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:09:26.154702 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.154537    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c7aa205-6329-40e5-9ff3-d4b46463ed1d-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:09:26.672295 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.672264    2563 generic.go:356] "Generic (PLEG): container finished" podID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerID="70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc" exitCode=0
Jul 16 22:09:26.672491 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.672316    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"
Jul 16 22:09:26.672491 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.672350    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" event={"ID":"0c7aa205-6329-40e5-9ff3-d4b46463ed1d","Type":"ContainerDied","Data":"70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc"}
Jul 16 22:09:26.672491 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.672401    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl" event={"ID":"0c7aa205-6329-40e5-9ff3-d4b46463ed1d","Type":"ContainerDied","Data":"58430ec81ad20f3735f69c6e3f7145f1fb5ba0faa2f30392667af64e725fedd8"}
Jul 16 22:09:26.672491 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.672425    2563 scope.go:117] "RemoveContainer" containerID="70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc"
Jul 16 22:09:26.682216 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.682200    2563 scope.go:117] "RemoveContainer" containerID="10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b"
Jul 16 22:09:26.690224 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.690207    2563 scope.go:117] "RemoveContainer" containerID="70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc"
Jul 16 22:09:26.690516 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:09:26.690493    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc\": container with ID starting with 70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc not found: ID does not exist" containerID="70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc"
Jul 16 22:09:26.690616 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.690523    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc"} err="failed to get container status \"70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc\": rpc error: code = NotFound desc = could not find container \"70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc\": container with ID starting with 70e1d76abb6f5935c4c55bdad9bd0f1eece2a69c89ab601405441a586d2a1cfc not found: ID does not exist"
Jul 16 22:09:26.690616 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.690542    2563 scope.go:117] "RemoveContainer" containerID="10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b"
Jul 16 22:09:26.690875 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:09:26.690855    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b\": container with ID starting with 10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b not found: ID does not exist" containerID="10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b"
Jul 16 22:09:26.690999 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.690918    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b"} err="failed to get container status \"10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b\": rpc error: code = NotFound desc = could not find container \"10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b\": container with ID starting with 10031b2783775e7ff5b70ab391afb1bfaae591bd62c92f45f61d85812971dd7b not found: ID does not exist"
Jul 16 22:09:26.693558 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.693539    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"]
Jul 16 22:09:26.698931 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:26.698911    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-910fadad-openshift-default-844654947f-xt7cl"]
Jul 16 22:09:27.672805 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:09:27.672771    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" path="/var/lib/kubelet/pods/0c7aa205-6329-40e5-9ff3-d4b46463ed1d/volumes"
Jul 16 22:10:15.605983 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.605930    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"]
Jul 16 22:10:15.606404 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.606318    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy"
Jul 16 22:10:15.606404 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.606330    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy"
Jul 16 22:10:15.606404 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.606343    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb41666f-8fe7-4d33-9651-06781529a9bc" containerName="main"
Jul 16 22:10:15.606404 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.606349    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb41666f-8fe7-4d33-9651-06781529a9bc" containerName="main"
Jul 16 22:10:15.606404 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.606360    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy"
Jul 16 22:10:15.606404 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.606369    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy"
Jul 16 22:10:15.606596 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.606445    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy"
Jul 16 22:10:15.606596 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.606454    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb41666f-8fe7-4d33-9651-06781529a9bc" containerName="main"
Jul 16 22:10:15.609464 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.609447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.612536 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.612519    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-9699fb-openshift-default-dockercfg-kndgg\""
Jul 16 22:10:15.627094 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.627073    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"]
Jul 16 22:10:15.679858 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.679814    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b139b64-0b70-4fc4-afc7-46bd67357d75-istiod-ca-cert\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.680073 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.679874    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-socket\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.680073 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.679906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-token\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.680073 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.679973    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-certs\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.680073 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.679999    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-data\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.680318 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.680091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-podinfo\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.680318 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.680136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-credential-socket\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.680318 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.680213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-envoy\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.680318 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.680243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zxd2\" (UniqueName: \"kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-kube-api-access-6zxd2\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781035 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.780994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-envoy\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781035 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781040    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zxd2\" (UniqueName: \"kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-kube-api-access-6zxd2\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781285 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b139b64-0b70-4fc4-afc7-46bd67357d75-istiod-ca-cert\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781285 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-socket\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781285 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-token\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781285 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-certs\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781285 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-data\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781285 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-podinfo\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781285 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-credential-socket\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781717 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781595    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-certs\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781717 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781626    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-socket\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.781717 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-data\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.782006 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.781977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b139b64-0b70-4fc4-afc7-46bd67357d75-istiod-ca-cert\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.782148 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.782000    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-credential-socket\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.783503 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.783483    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-envoy\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.783881 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.783864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-podinfo\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.788970 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.788928    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-token\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.789201 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.789182    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zxd2\" (UniqueName: \"kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-kube-api-access-6zxd2\") pod \"e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") " pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:15.920012 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:15.919912    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:16.099370 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:16.099344    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"]
Jul 16 22:10:16.101549 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:10:16.101517    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b139b64_0b70_4fc4_afc7_46bd67357d75.slice/crio-e35a6c01dddb6cfdb43dd1b7e39e4920afaaab0126edcc4a1b1aaa7a4bea59b7 WatchSource:0}: Error finding container e35a6c01dddb6cfdb43dd1b7e39e4920afaaab0126edcc4a1b1aaa7a4bea59b7: Status 404 returned error can't find the container with id e35a6c01dddb6cfdb43dd1b7e39e4920afaaab0126edcc4a1b1aaa7a4bea59b7
Jul 16 22:10:16.103771 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:16.103736    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:16.103855 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:16.103813    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:16.103855 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:16.103845    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:16.923022 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:16.922917    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" event={"ID":"2b139b64-0b70-4fc4-afc7-46bd67357d75","Type":"ContainerStarted","Data":"dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a"}
Jul 16 22:10:16.923022 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:16.923003    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" event={"ID":"2b139b64-0b70-4fc4-afc7-46bd67357d75","Type":"ContainerStarted","Data":"e35a6c01dddb6cfdb43dd1b7e39e4920afaaab0126edcc4a1b1aaa7a4bea59b7"}
Jul 16 22:10:16.946627 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:16.946575    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" podStartSLOduration=1.946560921 podStartE2EDuration="1.946560921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:10:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:10:16.94486549 +0000 UTC m=+1881.770510789" watchObservedRunningTime="2026-07-16 22:10:16.946560921 +0000 UTC m=+1881.772206279"
Jul 16 22:10:17.920119 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:17.920087    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:17.925287 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:17.925262    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:17.928384 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:17.928364    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:17.929194 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:17.929174    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:24.101564 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.101531    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"]
Jul 16 22:10:24.101997 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.101983    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c7aa205-6329-40e5-9ff3-d4b46463ed1d" containerName="istio-proxy"
Jul 16 22:10:24.105334 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.105318    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.108062 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.108040    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-496a80-openshift-default-dockercfg-hlkdd\""
Jul 16 22:10:24.140361 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.140334    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"]
Jul 16 22:10:24.152127 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.152101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db2mh\" (UniqueName: \"kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-kube-api-access-db2mh\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.152250 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.152175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-token\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.152325 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.152239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-credential-socket\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.152325 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.152314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-certs\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.152440 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.152351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-socket\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.152440 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.152404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-data\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.152440 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.152432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-envoy\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.152588 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.152490    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c616b677-53be-4c9b-9a65-b00ae528ffb7-istiod-ca-cert\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.152588 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.152526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-podinfo\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253106 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db2mh\" (UniqueName: \"kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-kube-api-access-db2mh\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253270 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-token\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253270 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-credential-socket\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253270 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-certs\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253270 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-socket\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253270 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-data\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253492 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253354    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-envoy\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253492 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c616b677-53be-4c9b-9a65-b00ae528ffb7-istiod-ca-cert\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253492 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-podinfo\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253638 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253608    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-credential-socket\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253691 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253677    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-data\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.253745 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.253708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-socket\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.254058 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.254031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-certs\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.254224 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.254204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c616b677-53be-4c9b-9a65-b00ae528ffb7-istiod-ca-cert\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.255822 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.255802    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-envoy\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.256092 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.256075    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-podinfo\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.267780 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.267750    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db2mh\" (UniqueName: \"kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-kube-api-access-db2mh\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.287503 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.287474    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-token\") pod \"e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") " pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.416966 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.416859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:24.563180 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.563144    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"]
Jul 16 22:10:24.563290 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:10:24.563244    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc616b677_53be_4c9b_9a65_b00ae528ffb7.slice/crio-979504874a65b8f67e4d0552888a48831ef1a5a35c36ff3b2c9e9e10da07631f WatchSource:0}: Error finding container 979504874a65b8f67e4d0552888a48831ef1a5a35c36ff3b2c9e9e10da07631f: Status 404 returned error can't find the container with id 979504874a65b8f67e4d0552888a48831ef1a5a35c36ff3b2c9e9e10da07631f
Jul 16 22:10:24.565511 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.565482    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:24.565615 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.565561    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:24.565615 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.565605    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:24.966277 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.966242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" event={"ID":"c616b677-53be-4c9b-9a65-b00ae528ffb7","Type":"ContainerStarted","Data":"480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd"}
Jul 16 22:10:24.966450 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:24.966292    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" event={"ID":"c616b677-53be-4c9b-9a65-b00ae528ffb7","Type":"ContainerStarted","Data":"979504874a65b8f67e4d0552888a48831ef1a5a35c36ff3b2c9e9e10da07631f"}
Jul 16 22:10:25.002301 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:25.002253    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" podStartSLOduration=1.002238178 podStartE2EDuration="1.002238178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:10:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:10:25.00071112 +0000 UTC m=+1889.826356442" watchObservedRunningTime="2026-07-16 22:10:25.002238178 +0000 UTC m=+1889.827883478"
Jul 16 22:10:25.417656 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:25.417563    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:25.422498 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:25.422472    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:25.971679 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:25.971647    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:25.972553 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:25.972534    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:26.907770 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:26.907725    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:10:33.970097 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:33.970059    2563 patch_prober.go:28] interesting pod/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 22:10:33.970544 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:33.970146    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:10:35.018808 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:35.018718    2563 generic.go:356] "Generic (PLEG): container finished" podID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerID="dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a" exitCode=0
Jul 16 22:10:35.018808 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:35.018794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" event={"ID":"2b139b64-0b70-4fc4-afc7-46bd67357d75","Type":"ContainerDied","Data":"dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a"}
Jul 16 22:10:35.019258 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:35.019185    2563 scope.go:117] "RemoveContainer" containerID="dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a"
Jul 16 22:10:35.020187 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:35.020160    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:35.020262 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:35.020233    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:35.020300 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:35.020265    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:36.026999 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:36.026965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" event={"ID":"2b139b64-0b70-4fc4-afc7-46bd67357d75","Type":"ContainerStarted","Data":"a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74"}
Jul 16 22:10:36.920807 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:36.920767    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:36.921041 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:36.920884    2563 patch_prober.go:28] interesting pod/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 16 22:10:36.921041 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:36.920927    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 16 22:10:37.921189 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:37.921147    2563 patch_prober.go:28] interesting pod/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 16 22:10:37.921669 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:37.921214    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 16 22:10:38.920547 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:38.920512    2563 patch_prober.go:28] interesting pod/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 16 22:10:38.920723 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:38.920566    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 16 22:10:39.108639 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:39.108597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:10:39.920956 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:39.920888    2563 patch_prober.go:28] interesting pod/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 16 22:10:39.921169 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:39.920999    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 16 22:10:40.924992 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:40.924929    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:40.925524 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:40.925499    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:40.926387 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:40.926369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:10:42.013977 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:42.013082    2563 patch_prober.go:28] interesting pod/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 22:10:42.013977 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:42.013166    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:10:43.083718 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:43.083682    2563 generic.go:356] "Generic (PLEG): container finished" podID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerID="480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd" exitCode=0
Jul 16 22:10:43.084110 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:43.083752    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" event={"ID":"c616b677-53be-4c9b-9a65-b00ae528ffb7","Type":"ContainerDied","Data":"480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd"}
Jul 16 22:10:43.084159 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:43.084150    2563 scope.go:117] "RemoveContainer" containerID="480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd"
Jul 16 22:10:43.085103 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:43.085078    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:43.085208 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:43.085141    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:43.085208 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:43.085171    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:10:44.096004 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:44.095969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" event={"ID":"c616b677-53be-4c9b-9a65-b00ae528ffb7","Type":"ContainerStarted","Data":"91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd"}
Jul 16 22:10:44.417998 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:44.417891    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:44.418178 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:44.418154    2563 patch_prober.go:28] interesting pod/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 16 22:10:44.418239 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:44.418219    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 16 22:10:45.417500 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:45.417467    2563 patch_prober.go:28] interesting pod/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 16 22:10:45.417899 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:45.417532    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 16 22:10:46.418098 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:46.418063    2563 patch_prober.go:28] interesting pod/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 16 22:10:46.418493 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:46.418128    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 16 22:10:47.417615 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:47.417580    2563 patch_prober.go:28] interesting pod/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Jul 16 22:10:47.417795 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:47.417647    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Jul 16 22:10:48.420703 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:48.420669    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:48.421186 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:48.420952    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:48.421615 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:48.421600    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:10:51.095364 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:10:51.095322    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:11:24.195287 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.195255    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"]
Jul 16 22:11:24.197916 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.197900    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.200314 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.200279    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-496a80\"/\"kube-root-ca.crt\""
Jul 16 22:11:24.201411 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.201389    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-496a80\"/\"openshift-service-ca.crt\""
Jul 16 22:11:24.201531 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.201480    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-496a80\"/\"default-dockercfg-f9f5s\""
Jul 16 22:11:24.201531 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.201519    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-496a80\"/\"test-model-496a80-kserve-self-signed-certs\""
Jul 16 22:11:24.210808 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.210786    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"]
Jul 16 22:11:24.273438 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.273412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-dshm\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.273590 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.273458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-model-cache\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.273590 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.273501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnhqw\" (UniqueName: \"kubernetes.io/projected/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-kube-api-access-wnhqw\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.273590 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.273549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-home\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.273590 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.273586    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tls-certs\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.273731 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.273614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tmp-dir\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.374895 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.374858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tls-certs\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.375094 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.374905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tmp-dir\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.375094 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.374973    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-dshm\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.375094 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.375015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-model-cache\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.375094 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.375047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnhqw\" (UniqueName: \"kubernetes.io/projected/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-kube-api-access-wnhqw\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.375094 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.375086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-home\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.375338 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.375293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tmp-dir\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.375451 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.375412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-model-cache\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.375451 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.375445    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-home\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.377455 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.377436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-dshm\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.377693 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.377677    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tls-certs\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.383109 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.383090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnhqw\" (UniqueName: \"kubernetes.io/projected/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-kube-api-access-wnhqw\") pod \"test-model-496a80-kserve-6bd6fcf5c7-dh9xj\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") " pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.507541 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.507462    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:24.649840 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:24.649806    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"]
Jul 16 22:11:24.652754 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:11:24.652726    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0854aaa1_32ca_479d_b31e_d7ec9f3dce06.slice/crio-663780f927283d4eb8da1ae40f4ab76baf4a006ece74fda54ff6ee52784b6eda WatchSource:0}: Error finding container 663780f927283d4eb8da1ae40f4ab76baf4a006ece74fda54ff6ee52784b6eda: Status 404 returned error can't find the container with id 663780f927283d4eb8da1ae40f4ab76baf4a006ece74fda54ff6ee52784b6eda
Jul 16 22:11:25.318533 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:25.318492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj" event={"ID":"0854aaa1-32ca-479d-b31e-d7ec9f3dce06","Type":"ContainerStarted","Data":"168b5b06c4fb68bb3b9c0025d9e37cc7803a5c76bbe9bb96466fa9c2cd2ba5e3"}
Jul 16 22:11:25.318533 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:25.318538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj" event={"ID":"0854aaa1-32ca-479d-b31e-d7ec9f3dce06","Type":"ContainerStarted","Data":"663780f927283d4eb8da1ae40f4ab76baf4a006ece74fda54ff6ee52784b6eda"}
Jul 16 22:11:28.201530 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:28.201478    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj" podStartSLOduration=4.201458698 podStartE2EDuration="4.201458698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:11:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:11:25.355778609 +0000 UTC m=+1950.181423909" watchObservedRunningTime="2026-07-16 22:11:28.201458698 +0000 UTC m=+1953.027103997"
Jul 16 22:11:28.203612 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:28.203592    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:11:34.508478 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:34.508441    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:34.509007 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:34.508503    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:34.521305 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:34.521285    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:35.386731 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:35.386705    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:11:46.242583 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:46.242554    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"]
Jul 16 22:11:46.493308 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:46.493221    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:11:58.986039 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:11:58.986008    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:12:01.263754 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.263708    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj" podUID="0854aaa1-32ca-479d-b31e-d7ec9f3dce06" containerName="main" containerID="cri-o://168b5b06c4fb68bb3b9c0025d9e37cc7803a5c76bbe9bb96466fa9c2cd2ba5e3" gracePeriod=45
Jul 16 22:12:01.514624 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.514548    2563 generic.go:356] "Generic (PLEG): container finished" podID="0854aaa1-32ca-479d-b31e-d7ec9f3dce06" containerID="168b5b06c4fb68bb3b9c0025d9e37cc7803a5c76bbe9bb96466fa9c2cd2ba5e3" exitCode=0
Jul 16 22:12:01.514794 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.514628    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj" event={"ID":"0854aaa1-32ca-479d-b31e-d7ec9f3dce06","Type":"ContainerDied","Data":"168b5b06c4fb68bb3b9c0025d9e37cc7803a5c76bbe9bb96466fa9c2cd2ba5e3"}
Jul 16 22:12:01.514794 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.514677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj" event={"ID":"0854aaa1-32ca-479d-b31e-d7ec9f3dce06","Type":"ContainerDied","Data":"663780f927283d4eb8da1ae40f4ab76baf4a006ece74fda54ff6ee52784b6eda"}
Jul 16 22:12:01.514794 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.514694    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="663780f927283d4eb8da1ae40f4ab76baf4a006ece74fda54ff6ee52784b6eda"
Jul 16 22:12:01.517743 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.517725    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:12:01.605870 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.605842    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnhqw\" (UniqueName: \"kubernetes.io/projected/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-kube-api-access-wnhqw\") pod \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") "
Jul 16 22:12:01.606038 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.605885    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-model-cache\") pod \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") "
Jul 16 22:12:01.606038 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.605930    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-home\") pod \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") "
Jul 16 22:12:01.606038 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.606011    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-dshm\") pod \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") "
Jul 16 22:12:01.606215 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.606064    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tls-certs\") pod \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") "
Jul 16 22:12:01.606215 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.606084    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tmp-dir\") pod \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\" (UID: \"0854aaa1-32ca-479d-b31e-d7ec9f3dce06\") "
Jul 16 22:12:01.606215 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.606186    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-model-cache" (OuterVolumeSpecName: "model-cache") pod "0854aaa1-32ca-479d-b31e-d7ec9f3dce06" (UID: "0854aaa1-32ca-479d-b31e-d7ec9f3dce06"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:01.606375 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.606264    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-home" (OuterVolumeSpecName: "home") pod "0854aaa1-32ca-479d-b31e-d7ec9f3dce06" (UID: "0854aaa1-32ca-479d-b31e-d7ec9f3dce06"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:01.606437 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.606381    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-model-cache\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:01.606437 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.606399    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-home\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:01.606437 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.606411    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0854aaa1-32ca-479d-b31e-d7ec9f3dce06" (UID: "0854aaa1-32ca-479d-b31e-d7ec9f3dce06"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:01.608269 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.608249    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-dshm" (OuterVolumeSpecName: "dshm") pod "0854aaa1-32ca-479d-b31e-d7ec9f3dce06" (UID: "0854aaa1-32ca-479d-b31e-d7ec9f3dce06"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:01.608358 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.608281    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0854aaa1-32ca-479d-b31e-d7ec9f3dce06" (UID: "0854aaa1-32ca-479d-b31e-d7ec9f3dce06"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:12:01.608414 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.608385    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-kube-api-access-wnhqw" (OuterVolumeSpecName: "kube-api-access-wnhqw") pod "0854aaa1-32ca-479d-b31e-d7ec9f3dce06" (UID: "0854aaa1-32ca-479d-b31e-d7ec9f3dce06"). InnerVolumeSpecName "kube-api-access-wnhqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:12:01.707700 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.707676    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-dshm\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:01.707700 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.707699    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tls-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:01.707853 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.707713    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-tmp-dir\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:01.707853 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:01.707724    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnhqw\" (UniqueName: \"kubernetes.io/projected/0854aaa1-32ca-479d-b31e-d7ec9f3dce06-kube-api-access-wnhqw\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:02.520202 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:02.520172    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"
Jul 16 22:12:02.536969 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:02.536914    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"]
Jul 16 22:12:02.540906 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:02.540881    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-496a80/test-model-496a80-kserve-6bd6fcf5c7-dh9xj"]
Jul 16 22:12:03.673997 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:03.673963    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0854aaa1-32ca-479d-b31e-d7ec9f3dce06" path="/var/lib/kubelet/pods/0854aaa1-32ca-479d-b31e-d7ec9f3dce06/volumes"
Jul 16 22:12:29.077497 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:29.077463    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"]
Jul 16 22:12:29.078062 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:29.077683    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy" containerID="cri-o://a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74" gracePeriod=30
Jul 16 22:12:33.891584 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:33.891556    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:12:34.334463 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.334440    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:12:34.480516 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480417    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b139b64-0b70-4fc4-afc7-46bd67357d75-istiod-ca-cert\") pod \"2b139b64-0b70-4fc4-afc7-46bd67357d75\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") "
Jul 16 22:12:34.480516 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480454    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-certs\") pod \"2b139b64-0b70-4fc4-afc7-46bd67357d75\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") "
Jul 16 22:12:34.480516 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480477    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-envoy\") pod \"2b139b64-0b70-4fc4-afc7-46bd67357d75\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") "
Jul 16 22:12:34.480825 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480617    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-socket\") pod \"2b139b64-0b70-4fc4-afc7-46bd67357d75\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") "
Jul 16 22:12:34.480825 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480654    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-token\") pod \"2b139b64-0b70-4fc4-afc7-46bd67357d75\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") "
Jul 16 22:12:34.480825 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480689    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-podinfo\") pod \"2b139b64-0b70-4fc4-afc7-46bd67357d75\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") "
Jul 16 22:12:34.480825 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480691    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b139b64-0b70-4fc4-afc7-46bd67357d75" (UID: "2b139b64-0b70-4fc4-afc7-46bd67357d75"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:34.480825 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480737    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zxd2\" (UniqueName: \"kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-kube-api-access-6zxd2\") pod \"2b139b64-0b70-4fc4-afc7-46bd67357d75\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") "
Jul 16 22:12:34.480825 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480813    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-data\") pod \"2b139b64-0b70-4fc4-afc7-46bd67357d75\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") "
Jul 16 22:12:34.481212 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480840    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-credential-socket\") pod \"2b139b64-0b70-4fc4-afc7-46bd67357d75\" (UID: \"2b139b64-0b70-4fc4-afc7-46bd67357d75\") "
Jul 16 22:12:34.481212 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480883    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b139b64-0b70-4fc4-afc7-46bd67357d75" (UID: "2b139b64-0b70-4fc4-afc7-46bd67357d75"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:34.481212 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.480914    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b139b64-0b70-4fc4-afc7-46bd67357d75-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b139b64-0b70-4fc4-afc7-46bd67357d75" (UID: "2b139b64-0b70-4fc4-afc7-46bd67357d75"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:12:34.481212 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.481138    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b139b64-0b70-4fc4-afc7-46bd67357d75" (UID: "2b139b64-0b70-4fc4-afc7-46bd67357d75"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:34.481589 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.481224    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b139b64-0b70-4fc4-afc7-46bd67357d75-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:34.481589 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.481243    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:34.481589 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.481256    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:34.481589 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.481267    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:34.481589 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.481528    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b139b64-0b70-4fc4-afc7-46bd67357d75" (UID: "2b139b64-0b70-4fc4-afc7-46bd67357d75"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:34.482957 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.482916    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b139b64-0b70-4fc4-afc7-46bd67357d75" (UID: "2b139b64-0b70-4fc4-afc7-46bd67357d75"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:12:34.483084 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.483069    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b139b64-0b70-4fc4-afc7-46bd67357d75" (UID: "2b139b64-0b70-4fc4-afc7-46bd67357d75"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:34.483448 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.483421    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-kube-api-access-6zxd2" (OuterVolumeSpecName: "kube-api-access-6zxd2") pod "2b139b64-0b70-4fc4-afc7-46bd67357d75" (UID: "2b139b64-0b70-4fc4-afc7-46bd67357d75"). InnerVolumeSpecName "kube-api-access-6zxd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:12:34.483448 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.483425    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b139b64-0b70-4fc4-afc7-46bd67357d75" (UID: "2b139b64-0b70-4fc4-afc7-46bd67357d75"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:12:34.582660 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.582631    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zxd2\" (UniqueName: \"kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-kube-api-access-6zxd2\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:34.582660 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.582658    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:34.582660 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.582667    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:34.582877 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.582674    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:34.582877 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.582682    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b139b64-0b70-4fc4-afc7-46bd67357d75-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:34.700704 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.700674    2563 generic.go:356] "Generic (PLEG): container finished" podID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerID="a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74" exitCode=0
Jul 16 22:12:34.700898 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.700737    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"
Jul 16 22:12:34.700898 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.700768    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" event={"ID":"2b139b64-0b70-4fc4-afc7-46bd67357d75","Type":"ContainerDied","Data":"a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74"}
Jul 16 22:12:34.700898 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.700821    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp" event={"ID":"2b139b64-0b70-4fc4-afc7-46bd67357d75","Type":"ContainerDied","Data":"e35a6c01dddb6cfdb43dd1b7e39e4920afaaab0126edcc4a1b1aaa7a4bea59b7"}
Jul 16 22:12:34.700898 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.700845    2563 scope.go:117] "RemoveContainer" containerID="a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74"
Jul 16 22:12:34.710425 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.710411    2563 scope.go:117] "RemoveContainer" containerID="dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a"
Jul 16 22:12:34.721802 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.721788    2563 scope.go:117] "RemoveContainer" containerID="a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74"
Jul 16 22:12:34.722111 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:12:34.722095    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74\": container with ID starting with a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74 not found: ID does not exist" containerID="a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74"
Jul 16 22:12:34.722178 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.722118    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74"} err="failed to get container status \"a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74\": rpc error: code = NotFound desc = could not find container \"a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74\": container with ID starting with a34adcba80f6ed51d7c5c950a71653f4befe0f932e841480ee70d2227f3dac74 not found: ID does not exist"
Jul 16 22:12:34.722178 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.722136    2563 scope.go:117] "RemoveContainer" containerID="dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a"
Jul 16 22:12:34.722384 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:12:34.722362    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a\": container with ID starting with dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a not found: ID does not exist" containerID="dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a"
Jul 16 22:12:34.722460 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.722395    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a"} err="failed to get container status \"dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a\": rpc error: code = NotFound desc = could not find container \"dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a\": container with ID starting with dd1776669fa56ac3c0d083d455fe278f67947c276e55c5d9c875492599eb229a not found: ID does not exist"
Jul 16 22:12:34.723052 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.723034    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"]
Jul 16 22:12:34.727269 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:34.727250    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-9699fb-openshift-default-5bc6855b7f-qgrzp"]
Jul 16 22:12:35.677550 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:35.677515    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" path="/var/lib/kubelet/pods/2b139b64-0b70-4fc4-afc7-46bd67357d75/volumes"
Jul 16 22:12:36.245825 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:36.245790    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"]
Jul 16 22:12:36.246108 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:36.246081    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy" containerID="cri-o://91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd" gracePeriod=30
Jul 16 22:12:37.150414 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.150385    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"]
Jul 16 22:12:37.150910 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.150890    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy"
Jul 16 22:12:37.151008 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.150913    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy"
Jul 16 22:12:37.151008 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.150929    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0854aaa1-32ca-479d-b31e-d7ec9f3dce06" containerName="main"
Jul 16 22:12:37.151008 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.150953    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0854aaa1-32ca-479d-b31e-d7ec9f3dce06" containerName="main"
Jul 16 22:12:37.151008 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.150969    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy"
Jul 16 22:12:37.151008 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.150977    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy"
Jul 16 22:12:37.151263 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.151089    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy"
Jul 16 22:12:37.151263 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.151102    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0854aaa1-32ca-479d-b31e-d7ec9f3dce06" containerName="main"
Jul 16 22:12:37.151263 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.151113    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b139b64-0b70-4fc4-afc7-46bd67357d75" containerName="istio-proxy"
Jul 16 22:12:37.154555 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.154535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.156806 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.156784    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-fc2964-openshift-default-dockercfg-jkhp7\""
Jul 16 22:12:37.166264 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.166242    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"]
Jul 16 22:12:37.306196 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.306162    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b067f025-e70d-4784-9d3b-ac695d7c70b2-istiod-ca-cert\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.306196 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.306202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-data\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.306419 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.306228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-socket\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.306419 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.306296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-certs\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.306419 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.306394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-podinfo\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.306530 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.306456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt5mr\" (UniqueName: \"kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-kube-api-access-wt5mr\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.306530 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.306516    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-credential-socket\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.306595 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.306543    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-envoy\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.306595 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.306583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-token\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407388 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407292    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b067f025-e70d-4784-9d3b-ac695d7c70b2-istiod-ca-cert\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407388 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407342    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-data\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407388 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-socket\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407683 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-certs\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407683 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-podinfo\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407683 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt5mr\" (UniqueName: \"kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-kube-api-access-wt5mr\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407683 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-credential-socket\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407683 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407679    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-envoy\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407973 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-token\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407973 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-data\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407973 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-certs\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.407973 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.407918    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-socket\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.408194 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.408077    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-credential-socket\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.408194 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.408154    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b067f025-e70d-4784-9d3b-ac695d7c70b2-istiod-ca-cert\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.410201 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.410172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-envoy\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.410349 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.410333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-podinfo\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.416457 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.416436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-token\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.416665 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.416645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt5mr\" (UniqueName: \"kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-kube-api-access-wt5mr\") pod \"e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") " pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.465131 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.465107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:37.610413 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.610385    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"]
Jul 16 22:12:37.611959 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:12:37.611914    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb067f025_e70d_4784_9d3b_ac695d7c70b2.slice/crio-ac29b45d5fa9bf02c3f3c16f58b26da6d33e5989161a1764d3527fba6cfe091a WatchSource:0}: Error finding container ac29b45d5fa9bf02c3f3c16f58b26da6d33e5989161a1764d3527fba6cfe091a: Status 404 returned error can't find the container with id ac29b45d5fa9bf02c3f3c16f58b26da6d33e5989161a1764d3527fba6cfe091a
Jul 16 22:12:37.614254 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.614227    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:12:37.614324 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.614293    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:12:37.614324 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.614320    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:12:37.718842 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.718797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" event={"ID":"b067f025-e70d-4784-9d3b-ac695d7c70b2","Type":"ContainerStarted","Data":"5b99796bb78834bde7831055b61b5aea5a7d9d315ac87c1f00df6ad07d8d0da1"}
Jul 16 22:12:37.719030 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.718878    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" event={"ID":"b067f025-e70d-4784-9d3b-ac695d7c70b2","Type":"ContainerStarted","Data":"ac29b45d5fa9bf02c3f3c16f58b26da6d33e5989161a1764d3527fba6cfe091a"}
Jul 16 22:12:37.741361 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:37.741299    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" podStartSLOduration=0.741277786 podStartE2EDuration="741.277786ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:12:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:12:37.738493689 +0000 UTC m=+2022.564138987" watchObservedRunningTime="2026-07-16 22:12:37.741277786 +0000 UTC m=+2022.566923086"
Jul 16 22:12:38.465334 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:38.465295    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:38.470394 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:38.470369    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:38.724563 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:38.724482    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:38.725470 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:38.725447    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:41.492768 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.492742    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:12:41.647914 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.647840    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c616b677-53be-4c9b-9a65-b00ae528ffb7-istiod-ca-cert\") pod \"c616b677-53be-4c9b-9a65-b00ae528ffb7\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") "
Jul 16 22:12:41.647914 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.647877    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-credential-socket\") pod \"c616b677-53be-4c9b-9a65-b00ae528ffb7\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") "
Jul 16 22:12:41.647914 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.647894    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-envoy\") pod \"c616b677-53be-4c9b-9a65-b00ae528ffb7\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") "
Jul 16 22:12:41.648206 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.647932    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-token\") pod \"c616b677-53be-4c9b-9a65-b00ae528ffb7\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") "
Jul 16 22:12:41.648206 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648093    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-certs\") pod \"c616b677-53be-4c9b-9a65-b00ae528ffb7\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") "
Jul 16 22:12:41.648206 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648153    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-data\") pod \"c616b677-53be-4c9b-9a65-b00ae528ffb7\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") "
Jul 16 22:12:41.648206 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648183    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-socket\") pod \"c616b677-53be-4c9b-9a65-b00ae528ffb7\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") "
Jul 16 22:12:41.648418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648235    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db2mh\" (UniqueName: \"kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-kube-api-access-db2mh\") pod \"c616b677-53be-4c9b-9a65-b00ae528ffb7\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") "
Jul 16 22:12:41.648418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648233    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c616b677-53be-4c9b-9a65-b00ae528ffb7" (UID: "c616b677-53be-4c9b-9a65-b00ae528ffb7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:41.648418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648275    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-podinfo\") pod \"c616b677-53be-4c9b-9a65-b00ae528ffb7\" (UID: \"c616b677-53be-4c9b-9a65-b00ae528ffb7\") "
Jul 16 22:12:41.648418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648362    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c616b677-53be-4c9b-9a65-b00ae528ffb7" (UID: "c616b677-53be-4c9b-9a65-b00ae528ffb7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:41.648418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648398    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c616b677-53be-4c9b-9a65-b00ae528ffb7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c616b677-53be-4c9b-9a65-b00ae528ffb7" (UID: "c616b677-53be-4c9b-9a65-b00ae528ffb7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:12:41.648668 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648465    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c616b677-53be-4c9b-9a65-b00ae528ffb7" (UID: "c616b677-53be-4c9b-9a65-b00ae528ffb7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:41.648668 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648646    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c616b677-53be-4c9b-9a65-b00ae528ffb7-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:41.648788 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648668    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:41.648788 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648681    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:41.648788 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.648694    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:41.649160 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.649135    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-data" (OuterVolumeSpecName: "istio-data") pod "c616b677-53be-4c9b-9a65-b00ae528ffb7" (UID: "c616b677-53be-4c9b-9a65-b00ae528ffb7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:41.650312 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.650284    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-token" (OuterVolumeSpecName: "istio-token") pod "c616b677-53be-4c9b-9a65-b00ae528ffb7" (UID: "c616b677-53be-4c9b-9a65-b00ae528ffb7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:12:41.650444 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.650428    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c616b677-53be-4c9b-9a65-b00ae528ffb7" (UID: "c616b677-53be-4c9b-9a65-b00ae528ffb7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:12:41.650861 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.650836    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-kube-api-access-db2mh" (OuterVolumeSpecName: "kube-api-access-db2mh") pod "c616b677-53be-4c9b-9a65-b00ae528ffb7" (UID: "c616b677-53be-4c9b-9a65-b00ae528ffb7"). InnerVolumeSpecName "kube-api-access-db2mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:12:41.650861 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.650834    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c616b677-53be-4c9b-9a65-b00ae528ffb7" (UID: "c616b677-53be-4c9b-9a65-b00ae528ffb7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:12:41.742570 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.742538    2563 generic.go:356] "Generic (PLEG): container finished" podID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerID="91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd" exitCode=0
Jul 16 22:12:41.742719 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.742586    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"
Jul 16 22:12:41.742719 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.742624    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" event={"ID":"c616b677-53be-4c9b-9a65-b00ae528ffb7","Type":"ContainerDied","Data":"91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd"}
Jul 16 22:12:41.742719 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.742680    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66" event={"ID":"c616b677-53be-4c9b-9a65-b00ae528ffb7","Type":"ContainerDied","Data":"979504874a65b8f67e4d0552888a48831ef1a5a35c36ff3b2c9e9e10da07631f"}
Jul 16 22:12:41.742719 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.742709    2563 scope.go:117] "RemoveContainer" containerID="91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd"
Jul 16 22:12:41.749431 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.749404    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:41.749533 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.749435    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:41.749533 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.749444    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:41.749533 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.749453    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db2mh\" (UniqueName: \"kubernetes.io/projected/c616b677-53be-4c9b-9a65-b00ae528ffb7-kube-api-access-db2mh\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:41.749533 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.749461    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c616b677-53be-4c9b-9a65-b00ae528ffb7-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:12:41.752024 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.752006    2563 scope.go:117] "RemoveContainer" containerID="480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd"
Jul 16 22:12:41.760927 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.760895    2563 scope.go:117] "RemoveContainer" containerID="91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd"
Jul 16 22:12:41.761241 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:12:41.761223    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd\": container with ID starting with 91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd not found: ID does not exist" containerID="91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd"
Jul 16 22:12:41.761297 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.761249    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd"} err="failed to get container status \"91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd\": rpc error: code = NotFound desc = could not find container \"91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd\": container with ID starting with 91ace80efc26fda2db82ff32bd0fc6fa75a7d88ac9e331a0e24944759ea426bd not found: ID does not exist"
Jul 16 22:12:41.761297 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.761267    2563 scope.go:117] "RemoveContainer" containerID="480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd"
Jul 16 22:12:41.761543 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:12:41.761516    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd\": container with ID starting with 480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd not found: ID does not exist" containerID="480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd"
Jul 16 22:12:41.761617 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.761541    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd"} err="failed to get container status \"480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd\": rpc error: code = NotFound desc = could not find container \"480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd\": container with ID starting with 480de0251b98e132a059667a96c14867ce18841abcde3161dacaacfe33565ecd not found: ID does not exist"
Jul 16 22:12:41.763404 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.763385    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"]
Jul 16 22:12:41.767696 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:41.767675    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-496a80-openshift-default-dc7678b55-gtt66"]
Jul 16 22:12:43.672910 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:43.672868    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" path="/var/lib/kubelet/pods/c616b677-53be-4c9b-9a65-b00ae528ffb7/volumes"
Jul 16 22:12:44.913139 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:44.913109    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"]
Jul 16 22:12:44.913501 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:44.913456    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy"
Jul 16 22:12:44.913501 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:44.913468    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy"
Jul 16 22:12:44.913501 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:44.913478    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy"
Jul 16 22:12:44.913501 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:44.913484    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy"
Jul 16 22:12:44.913644 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:44.913537    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy"
Jul 16 22:12:44.913644 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:44.913548    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c616b677-53be-4c9b-9a65-b00ae528ffb7" containerName="istio-proxy"
Jul 16 22:12:44.917965 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:44.917926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:44.920317 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:44.920299    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-f82999-openshift-default-dockercfg-dmnn8\""
Jul 16 22:12:44.930983 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:44.930957    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"]
Jul 16 22:12:45.080202 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.080168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-podinfo\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.080202 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.080202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmb9k\" (UniqueName: \"kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-kube-api-access-fmb9k\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.080479 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.080246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-certs\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.080479 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.080336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-data\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.080479 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.080373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85ec989-65ad-49c4-987c-4ea3d62707b0-istiod-ca-cert\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.080479 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.080452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-credential-socket\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.080680 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.080497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-token\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.080680 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.080556    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-envoy\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.080680 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.080593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-socket\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.181534 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.181503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-socket\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.181716 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.181575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-podinfo\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.181716 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.181599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmb9k\" (UniqueName: \"kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-kube-api-access-fmb9k\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.181716 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.181633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-certs\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.181716 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.181694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-data\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.181934 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.181735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85ec989-65ad-49c4-987c-4ea3d62707b0-istiod-ca-cert\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.181934 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.181800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-credential-socket\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.181934 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.181826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-token\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.181934 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.181929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-envoy\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.182158 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.182029    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-socket\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.182158 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.182060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-certs\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.182376 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.182360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-data\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.182445 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.182364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-credential-socket\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.182568 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.182551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85ec989-65ad-49c4-987c-4ea3d62707b0-istiod-ca-cert\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.184272 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.184242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-podinfo\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.184367 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.184293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-envoy\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.194596 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.194577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-token\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.195088 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.195068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmb9k\" (UniqueName: \"kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-kube-api-access-fmb9k\") pod \"e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") " pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.229839 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.229808    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:45.380160 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.380136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"]
Jul 16 22:12:45.381679 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:12:45.381654    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85ec989_65ad_49c4_987c_4ea3d62707b0.slice/crio-d44ef58bcb1abd50924efa2647a97ca43c21341bd4a570d9efabbfadc7908617 WatchSource:0}: Error finding container d44ef58bcb1abd50924efa2647a97ca43c21341bd4a570d9efabbfadc7908617: Status 404 returned error can't find the container with id d44ef58bcb1abd50924efa2647a97ca43c21341bd4a570d9efabbfadc7908617
Jul 16 22:12:45.383699 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.383671    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:12:45.383799 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.383730    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:12:45.383799 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.383758    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:12:45.767013 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.766906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" event={"ID":"f85ec989-65ad-49c4-987c-4ea3d62707b0","Type":"ContainerStarted","Data":"a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3"}
Jul 16 22:12:45.767178 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.767015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" event={"ID":"f85ec989-65ad-49c4-987c-4ea3d62707b0","Type":"ContainerStarted","Data":"d44ef58bcb1abd50924efa2647a97ca43c21341bd4a570d9efabbfadc7908617"}
Jul 16 22:12:45.789404 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:45.789346    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" podStartSLOduration=1.789329261 podStartE2EDuration="1.789329261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:12:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:12:45.788835385 +0000 UTC m=+2030.614480684" watchObservedRunningTime="2026-07-16 22:12:45.789329261 +0000 UTC m=+2030.614974561"
Jul 16 22:12:46.229957 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:46.229905    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:46.235558 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:46.235538    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:46.772418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:46.772388    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:46.773440 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:46.773416    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:12:48.087244 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:48.087208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:12:54.766149 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:54.766103    2563 patch_prober.go:28] interesting pod/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 22:12:54.766612 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:54.766191    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:12:56.838320 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:56.838282    2563 generic.go:356] "Generic (PLEG): container finished" podID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerID="5b99796bb78834bde7831055b61b5aea5a7d9d315ac87c1f00df6ad07d8d0da1" exitCode=0
Jul 16 22:12:56.838973 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:56.838364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" event={"ID":"b067f025-e70d-4784-9d3b-ac695d7c70b2","Type":"ContainerDied","Data":"5b99796bb78834bde7831055b61b5aea5a7d9d315ac87c1f00df6ad07d8d0da1"}
Jul 16 22:12:56.839759 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:56.839741    2563 scope.go:117] "RemoveContainer" containerID="5b99796bb78834bde7831055b61b5aea5a7d9d315ac87c1f00df6ad07d8d0da1"
Jul 16 22:12:56.841745 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:56.841712    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:12:56.841967 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:56.841923    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:12:56.842122 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:56.842104    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:12:57.850364 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:57.850324    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" event={"ID":"b067f025-e70d-4784-9d3b-ac695d7c70b2","Type":"ContainerStarted","Data":"1ede903be3fba79be23611184a3e73a875370199f8b56dc20a2b775d15ea6d1c"}
Jul 16 22:12:58.465592 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:58.465544    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:12:58.466126 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:58.466093    2563 patch_prober.go:28] interesting pod/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 16 22:12:58.466250 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:58.466167    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 16 22:12:59.466451 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:59.466400    2563 patch_prober.go:28] interesting pod/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 16 22:12:59.467025 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:12:59.466479    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 16 22:13:00.466323 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:00.466277    2563 patch_prober.go:28] interesting pod/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 16 22:13:00.466652 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:00.466360    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 16 22:13:01.466020 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:01.465983    2563 patch_prober.go:28] interesting pod/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Jul 16 22:13:01.466184 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:01.466045    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Jul 16 22:13:01.493302 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:01.493270    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:13:02.470159 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:02.470126    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:13:02.470522 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:02.470503    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:13:02.471250 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:02.471234    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:13:02.814145 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:02.814058    2563 patch_prober.go:28] interesting pod/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 22:13:02.814145 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:02.814115    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 22:13:04.896122 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:04.896085    2563 generic.go:356] "Generic (PLEG): container finished" podID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerID="a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3" exitCode=0
Jul 16 22:13:04.896588 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:04.896156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" event={"ID":"f85ec989-65ad-49c4-987c-4ea3d62707b0","Type":"ContainerDied","Data":"a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3"}
Jul 16 22:13:04.896588 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:04.896564    2563 scope.go:117] "RemoveContainer" containerID="a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3"
Jul 16 22:13:04.897583 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:04.897558    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:04.897656 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:04.897639    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:04.897697 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:04.897686    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:05.903186 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:05.903147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" event={"ID":"f85ec989-65ad-49c4-987c-4ea3d62707b0","Type":"ContainerStarted","Data":"a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29"}
Jul 16 22:13:06.230024 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:06.229989    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:13:06.230347 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:06.230317    2563 patch_prober.go:28] interesting pod/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 16 22:13:06.230442 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:06.230375    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 16 22:13:06.785223 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:06.785192    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"]
Jul 16 22:13:06.785402 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:06.785374    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy" containerID="cri-o://1ede903be3fba79be23611184a3e73a875370199f8b56dc20a2b775d15ea6d1c" gracePeriod=30
Jul 16 22:13:07.230572 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:07.230532    2563 patch_prober.go:28] interesting pod/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 16 22:13:07.231174 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:07.231139    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 16 22:13:08.231122 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:08.230643    2563 patch_prober.go:28] interesting pod/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 16 22:13:08.231122 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:08.230705    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 16 22:13:09.230697 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:09.230658    2563 patch_prober.go:28] interesting pod/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 16 22:13:09.231062 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:09.231028    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 16 22:13:10.233647 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:10.233617    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:13:10.234135 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:10.233881    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:13:10.234502 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:10.234486    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:13:11.490704 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:11.490673    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:13:11.939629 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:11.939593    2563 generic.go:356] "Generic (PLEG): container finished" podID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerID="1ede903be3fba79be23611184a3e73a875370199f8b56dc20a2b775d15ea6d1c" exitCode=0
Jul 16 22:13:11.939791 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:11.939669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" event={"ID":"b067f025-e70d-4784-9d3b-ac695d7c70b2","Type":"ContainerDied","Data":"1ede903be3fba79be23611184a3e73a875370199f8b56dc20a2b775d15ea6d1c"}
Jul 16 22:13:11.939791 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:11.939740    2563 scope.go:117] "RemoveContainer" containerID="5b99796bb78834bde7831055b61b5aea5a7d9d315ac87c1f00df6ad07d8d0da1"
Jul 16 22:13:12.050041 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.050020    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:13:12.142776 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.142692    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-data\") pod \"b067f025-e70d-4784-9d3b-ac695d7c70b2\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") "
Jul 16 22:13:12.142776 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.142737    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-certs\") pod \"b067f025-e70d-4784-9d3b-ac695d7c70b2\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") "
Jul 16 22:13:12.143034 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.142778    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt5mr\" (UniqueName: \"kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-kube-api-access-wt5mr\") pod \"b067f025-e70d-4784-9d3b-ac695d7c70b2\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") "
Jul 16 22:13:12.143034 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.142796    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-token\") pod \"b067f025-e70d-4784-9d3b-ac695d7c70b2\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") "
Jul 16 22:13:12.143034 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.142814    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-credential-socket\") pod \"b067f025-e70d-4784-9d3b-ac695d7c70b2\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") "
Jul 16 22:13:12.143034 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.142861    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-socket\") pod \"b067f025-e70d-4784-9d3b-ac695d7c70b2\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") "
Jul 16 22:13:12.143034 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.142886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-podinfo\") pod \"b067f025-e70d-4784-9d3b-ac695d7c70b2\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") "
Jul 16 22:13:12.143034 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.142918    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-envoy\") pod \"b067f025-e70d-4784-9d3b-ac695d7c70b2\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") "
Jul 16 22:13:12.143034 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.142971    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b067f025-e70d-4784-9d3b-ac695d7c70b2-istiod-ca-cert\") pod \"b067f025-e70d-4784-9d3b-ac695d7c70b2\" (UID: \"b067f025-e70d-4784-9d3b-ac695d7c70b2\") "
Jul 16 22:13:12.143398 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.143222    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b067f025-e70d-4784-9d3b-ac695d7c70b2" (UID: "b067f025-e70d-4784-9d3b-ac695d7c70b2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:13:12.143398 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.143235    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b067f025-e70d-4784-9d3b-ac695d7c70b2" (UID: "b067f025-e70d-4784-9d3b-ac695d7c70b2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:13:12.143510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.143486    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b067f025-e70d-4784-9d3b-ac695d7c70b2" (UID: "b067f025-e70d-4784-9d3b-ac695d7c70b2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:13:12.143510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.143501    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b067f025-e70d-4784-9d3b-ac695d7c70b2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b067f025-e70d-4784-9d3b-ac695d7c70b2" (UID: "b067f025-e70d-4784-9d3b-ac695d7c70b2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:13:12.143618 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.143583    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-data" (OuterVolumeSpecName: "istio-data") pod "b067f025-e70d-4784-9d3b-ac695d7c70b2" (UID: "b067f025-e70d-4784-9d3b-ac695d7c70b2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:13:12.145332 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.145301    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-token" (OuterVolumeSpecName: "istio-token") pod "b067f025-e70d-4784-9d3b-ac695d7c70b2" (UID: "b067f025-e70d-4784-9d3b-ac695d7c70b2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:13:12.145475 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.145458    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b067f025-e70d-4784-9d3b-ac695d7c70b2" (UID: "b067f025-e70d-4784-9d3b-ac695d7c70b2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:13:12.145533 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.145506    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b067f025-e70d-4784-9d3b-ac695d7c70b2" (UID: "b067f025-e70d-4784-9d3b-ac695d7c70b2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:13:12.145642 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.145618    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-kube-api-access-wt5mr" (OuterVolumeSpecName: "kube-api-access-wt5mr") pod "b067f025-e70d-4784-9d3b-ac695d7c70b2" (UID: "b067f025-e70d-4784-9d3b-ac695d7c70b2"). InnerVolumeSpecName "kube-api-access-wt5mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:13:12.244056 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.244027    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:12.244056 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.244051    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:12.244056 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.244060    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt5mr\" (UniqueName: \"kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-kube-api-access-wt5mr\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:12.244274 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.244069    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:12.244274 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.244079    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:12.244274 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.244087    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:12.244274 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.244095    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:12.244274 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.244102    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b067f025-e70d-4784-9d3b-ac695d7c70b2-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:12.244274 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.244109    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b067f025-e70d-4784-9d3b-ac695d7c70b2-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:12.946366 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.946343    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"
Jul 16 22:13:12.946366 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.946343    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8" event={"ID":"b067f025-e70d-4784-9d3b-ac695d7c70b2","Type":"ContainerDied","Data":"ac29b45d5fa9bf02c3f3c16f58b26da6d33e5989161a1764d3527fba6cfe091a"}
Jul 16 22:13:12.946844 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.946397    2563 scope.go:117] "RemoveContainer" containerID="1ede903be3fba79be23611184a3e73a875370199f8b56dc20a2b775d15ea6d1c"
Jul 16 22:13:12.967370 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.967339    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"]
Jul 16 22:13:12.969525 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:12.969504    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-fc2964-openshift-default-555bf899f9-6p8s8"]
Jul 16 22:13:13.656214 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:13.656185    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"]
Jul 16 22:13:13.656457 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:13.656417    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy" containerID="cri-o://a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29" gracePeriod=30
Jul 16 22:13:13.674313 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:13.674287    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" path="/var/lib/kubelet/pods/b067f025-e70d-4784-9d3b-ac695d7c70b2/volumes"
Jul 16 22:13:14.490813 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.490782    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"]
Jul 16 22:13:14.491321 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.491297    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy"
Jul 16 22:13:14.491467 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.491420    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy"
Jul 16 22:13:14.491467 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.491459    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy"
Jul 16 22:13:14.491586 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.491469    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy"
Jul 16 22:13:14.491586 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.491578    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy"
Jul 16 22:13:14.494467 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.494447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.496932 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.496912    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-5d61a3-openshift-default-dockercfg-l6cmw\""
Jul 16 22:13:14.507881 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.507861    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"]
Jul 16 22:13:14.562286 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.562259    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-socket\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.562418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.562294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aaed010-056c-4189-9205-098cf4f627e3-istio-podinfo\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.562418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.562339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-credential-socket\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.562418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.562365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-certs\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.562418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.562390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-istio-token\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.562556 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.562416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-envoy\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.562556 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.562460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr5lv\" (UniqueName: \"kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-kube-api-access-zr5lv\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.562556 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.562505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aaed010-056c-4189-9205-098cf4f627e3-istiod-ca-cert\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.562556 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.562521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-data\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.663646 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.663612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aaed010-056c-4189-9205-098cf4f627e3-istiod-ca-cert\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.663646 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.663648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-data\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.663857 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.663670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-socket\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.663895 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.663846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aaed010-056c-4189-9205-098cf4f627e3-istio-podinfo\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.663981 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.663962    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-credential-socket\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.664046 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.664007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-certs\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.664099 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.664052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-istio-token\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.664099 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.664089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-envoy\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.664208 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.664096    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-data\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.664208 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.664153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr5lv\" (UniqueName: \"kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-kube-api-access-zr5lv\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.664392 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.664326    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-credential-socket\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.664392 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.664345    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-certs\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.664392 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.664056    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-socket\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.664557 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.664468    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aaed010-056c-4189-9205-098cf4f627e3-istiod-ca-cert\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.666477 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.666444    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-envoy\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.666576 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.666545    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aaed010-056c-4189-9205-098cf4f627e3-istio-podinfo\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.671394 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.671373    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-istio-token\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.672145 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.672129    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr5lv\" (UniqueName: \"kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-kube-api-access-zr5lv\") pod \"e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") " pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.804547 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.804469    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:14.950251 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.950228    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"]
Jul 16 22:13:14.951681 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:13:14.951653    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aaed010_056c_4189_9205_098cf4f627e3.slice/crio-b9da211c4479c0c5f1c0e5887fe5d2638f0eb0666f9df30148dd9f0efa63832c WatchSource:0}: Error finding container b9da211c4479c0c5f1c0e5887fe5d2638f0eb0666f9df30148dd9f0efa63832c: Status 404 returned error can't find the container with id b9da211c4479c0c5f1c0e5887fe5d2638f0eb0666f9df30148dd9f0efa63832c
Jul 16 22:13:14.953903 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.953868    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:14.953999 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.953981    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:14.954048 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.954029    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:14.959050 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:14.959030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" event={"ID":"7aaed010-056c-4189-9205-098cf4f627e3","Type":"ContainerStarted","Data":"b9da211c4479c0c5f1c0e5887fe5d2638f0eb0666f9df30148dd9f0efa63832c"}
Jul 16 22:13:15.966061 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:15.966031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" event={"ID":"7aaed010-056c-4189-9205-098cf4f627e3","Type":"ContainerStarted","Data":"43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c"}
Jul 16 22:13:15.986331 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:15.986281    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" podStartSLOduration=1.986267526 podStartE2EDuration="1.986267526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:13:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:13:15.985489619 +0000 UTC m=+2060.811134924" watchObservedRunningTime="2026-07-16 22:13:15.986267526 +0000 UTC m=+2060.811912826"
Jul 16 22:13:16.804808 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:16.804721    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:16.809742 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:16.809719    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:16.971803 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:16.971771    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:16.972812 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:16.972796    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:18.918012 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:18.917949    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:13:18.984877 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:18.984843    2563 generic.go:356] "Generic (PLEG): container finished" podID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerID="a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29" exitCode=0
Jul 16 22:13:18.985091 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:18.984888    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"
Jul 16 22:13:18.985091 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:18.984961    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" event={"ID":"f85ec989-65ad-49c4-987c-4ea3d62707b0","Type":"ContainerDied","Data":"a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29"}
Jul 16 22:13:18.985091 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:18.985017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9" event={"ID":"f85ec989-65ad-49c4-987c-4ea3d62707b0","Type":"ContainerDied","Data":"d44ef58bcb1abd50924efa2647a97ca43c21341bd4a570d9efabbfadc7908617"}
Jul 16 22:13:18.985091 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:18.985049    2563 scope.go:117] "RemoveContainer" containerID="a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29"
Jul 16 22:13:18.994077 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:18.994060    2563 scope.go:117] "RemoveContainer" containerID="a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3"
Jul 16 22:13:19.002231 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.002216    2563 scope.go:117] "RemoveContainer" containerID="a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29"
Jul 16 22:13:19.002529 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:13:19.002503    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29\": container with ID starting with a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29 not found: ID does not exist" containerID="a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29"
Jul 16 22:13:19.002568 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.002539    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29"} err="failed to get container status \"a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29\": rpc error: code = NotFound desc = could not find container \"a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29\": container with ID starting with a8292ec2cac6a5bcd5c8f803f82a91340852df5d67f87fae163031d913dcfc29 not found: ID does not exist"
Jul 16 22:13:19.002568 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.002558    2563 scope.go:117] "RemoveContainer" containerID="a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3"
Jul 16 22:13:19.002814 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:13:19.002798    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3\": container with ID starting with a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3 not found: ID does not exist" containerID="a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3"
Jul 16 22:13:19.002876 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.002816    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3"} err="failed to get container status \"a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3\": rpc error: code = NotFound desc = could not find container \"a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3\": container with ID starting with a38002a33704ef90fabecc9ee733f007baaa8cbf3614a0dfd45c3d00e2f881d3 not found: ID does not exist"
Jul 16 22:13:19.004052 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004036    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-socket\") pod \"f85ec989-65ad-49c4-987c-4ea3d62707b0\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") "
Jul 16 22:13:19.004101 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004090    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmb9k\" (UniqueName: \"kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-kube-api-access-fmb9k\") pod \"f85ec989-65ad-49c4-987c-4ea3d62707b0\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") "
Jul 16 22:13:19.004149 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004106    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-certs\") pod \"f85ec989-65ad-49c4-987c-4ea3d62707b0\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") "
Jul 16 22:13:19.004149 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004125    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-data\") pod \"f85ec989-65ad-49c4-987c-4ea3d62707b0\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") "
Jul 16 22:13:19.004263 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004174    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-podinfo\") pod \"f85ec989-65ad-49c4-987c-4ea3d62707b0\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") "
Jul 16 22:13:19.004263 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004192    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85ec989-65ad-49c4-987c-4ea3d62707b0-istiod-ca-cert\") pod \"f85ec989-65ad-49c4-987c-4ea3d62707b0\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") "
Jul 16 22:13:19.004263 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004236    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-token\") pod \"f85ec989-65ad-49c4-987c-4ea3d62707b0\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") "
Jul 16 22:13:19.004411 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004294    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-credential-socket\") pod \"f85ec989-65ad-49c4-987c-4ea3d62707b0\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") "
Jul 16 22:13:19.004411 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f85ec989-65ad-49c4-987c-4ea3d62707b0" (UID: "f85ec989-65ad-49c4-987c-4ea3d62707b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:13:19.004411 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004313    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-envoy\") pod \"f85ec989-65ad-49c4-987c-4ea3d62707b0\" (UID: \"f85ec989-65ad-49c4-987c-4ea3d62707b0\") "
Jul 16 22:13:19.004579 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004442    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f85ec989-65ad-49c4-987c-4ea3d62707b0" (UID: "f85ec989-65ad-49c4-987c-4ea3d62707b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:13:19.004631 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004614    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f85ec989-65ad-49c4-987c-4ea3d62707b0" (UID: "f85ec989-65ad-49c4-987c-4ea3d62707b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:13:19.004680 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004668    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:19.004732 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004682    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:19.004967 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.004754    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f85ec989-65ad-49c4-987c-4ea3d62707b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f85ec989-65ad-49c4-987c-4ea3d62707b0" (UID: "f85ec989-65ad-49c4-987c-4ea3d62707b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:13:19.005533 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.005491    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "f85ec989-65ad-49c4-987c-4ea3d62707b0" (UID: "f85ec989-65ad-49c4-987c-4ea3d62707b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:13:19.006389 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.006364    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-kube-api-access-fmb9k" (OuterVolumeSpecName: "kube-api-access-fmb9k") pod "f85ec989-65ad-49c4-987c-4ea3d62707b0" (UID: "f85ec989-65ad-49c4-987c-4ea3d62707b0"). InnerVolumeSpecName "kube-api-access-fmb9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:13:19.006551 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.006531    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f85ec989-65ad-49c4-987c-4ea3d62707b0" (UID: "f85ec989-65ad-49c4-987c-4ea3d62707b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:13:19.006629 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.006531    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "f85ec989-65ad-49c4-987c-4ea3d62707b0" (UID: "f85ec989-65ad-49c4-987c-4ea3d62707b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:13:19.006903 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.006880    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f85ec989-65ad-49c4-987c-4ea3d62707b0" (UID: "f85ec989-65ad-49c4-987c-4ea3d62707b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:13:19.105475 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.105434    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:19.105475 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.105472    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:19.105475 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.105485    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmb9k\" (UniqueName: \"kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-kube-api-access-fmb9k\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:19.105762 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.105495    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:19.105762 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.105504    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:19.105762 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.105512    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f85ec989-65ad-49c4-987c-4ea3d62707b0-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:19.105762 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.105519    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f85ec989-65ad-49c4-987c-4ea3d62707b0-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:13:19.308240 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.308200    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"]
Jul 16 22:13:19.314411 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.314385    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-f82999-openshift-default-879b8cdb7-lh9x9"]
Jul 16 22:13:19.673342 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:19.673262    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" path="/var/lib/kubelet/pods/f85ec989-65ad-49c4-987c-4ea3d62707b0/volumes"
Jul 16 22:13:22.966930 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:22.966891    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"]
Jul 16 22:13:22.967452 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:22.967434    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy"
Jul 16 22:13:22.967523 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:22.967456    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy"
Jul 16 22:13:22.967523 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:22.967468    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy"
Jul 16 22:13:22.967523 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:22.967477    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy"
Jul 16 22:13:22.967677 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:22.967571    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b067f025-e70d-4784-9d3b-ac695d7c70b2" containerName="istio-proxy"
Jul 16 22:13:22.967677 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:22.967585    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy"
Jul 16 22:13:22.970895 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:22.970872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:22.973323 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:22.973303    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-ff5f80-openshift-default-dockercfg-m2twc\""
Jul 16 22:13:22.985349 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:22.985328    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"]
Jul 16 22:13:23.141332 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.141297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-envoy\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.141332 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.141335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-token\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.141582 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.141414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-podinfo\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.141582 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.141442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-certs\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.141582 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.141508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-data\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.141582 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.141544    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-socket\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.141582 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.141568    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2gxq\" (UniqueName: \"kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-kube-api-access-k2gxq\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.141795 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.141617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-credential-socket\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.141795 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.141653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5c21f7e-af46-4811-954e-30de0e7e367e-istiod-ca-cert\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243134 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-data\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243134 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-socket\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243134 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2gxq\" (UniqueName: \"kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-kube-api-access-k2gxq\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243134 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-credential-socket\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243470 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5c21f7e-af46-4811-954e-30de0e7e367e-istiod-ca-cert\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243470 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-envoy\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243577 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-token\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243577 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243518    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-data\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243577 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243539    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-socket\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243577 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-podinfo\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243776 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243590    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-certs\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243776 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-credential-socket\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243899 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5c21f7e-af46-4811-954e-30de0e7e367e-istiod-ca-cert\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.243969 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.243878    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-certs\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.246052 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.246031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-podinfo\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.246152 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.246127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-envoy\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.251424 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.251396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-token\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.251901 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.251885    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2gxq\" (UniqueName: \"kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-kube-api-access-k2gxq\") pod \"e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") " pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.280762 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.280741    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:23.296605 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.296571    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:13:23.422583 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.422560    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"]
Jul 16 22:13:23.424406 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:13:23.424381    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c21f7e_af46_4811_954e_30de0e7e367e.slice/crio-a52d27891e79a7dc947f31f0628d3df8524791bc5194316de61693b8fa7b8293 WatchSource:0}: Error finding container a52d27891e79a7dc947f31f0628d3df8524791bc5194316de61693b8fa7b8293: Status 404 returned error can't find the container with id a52d27891e79a7dc947f31f0628d3df8524791bc5194316de61693b8fa7b8293
Jul 16 22:13:23.426816 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.426781    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:23.426930 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.426875    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:23.426930 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:23.426919    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:24.020442 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:24.020403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" event={"ID":"b5c21f7e-af46-4811-954e-30de0e7e367e","Type":"ContainerStarted","Data":"2100366372b67fa1b67962c31a84c712a62d605d002e03f6699470c6d640f3a6"}
Jul 16 22:13:24.020846 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:24.020460    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" event={"ID":"b5c21f7e-af46-4811-954e-30de0e7e367e","Type":"ContainerStarted","Data":"a52d27891e79a7dc947f31f0628d3df8524791bc5194316de61693b8fa7b8293"}
Jul 16 22:13:24.046107 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:24.046050    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" podStartSLOduration=2.046033334 podStartE2EDuration="2.046033334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:13:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:13:24.043785823 +0000 UTC m=+2068.869431125" watchObservedRunningTime="2026-07-16 22:13:24.046033334 +0000 UTC m=+2068.871678710"
Jul 16 22:13:24.281257 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:24.281171    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:24.286138 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:24.286115    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:25.027389 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:25.027354    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:25.029609 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:25.029582    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:31.973589 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:31.973553    2563 patch_prober.go:28] interesting pod/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 16 22:13:31.974061 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:31.973607    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 16 22:13:32.085396 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:32.085364    2563 generic.go:356] "Generic (PLEG): container finished" podID="7aaed010-056c-4189-9205-098cf4f627e3" containerID="43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c" exitCode=0
Jul 16 22:13:32.085567 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:32.085424    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" event={"ID":"7aaed010-056c-4189-9205-098cf4f627e3","Type":"ContainerDied","Data":"43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c"}
Jul 16 22:13:32.085840 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:32.085825    2563 scope.go:117] "RemoveContainer" containerID="43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c"
Jul 16 22:13:32.086821 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:32.086796    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:32.086885 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:32.086862    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:32.086934 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:32.086894    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:33.092861 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:33.092828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" event={"ID":"7aaed010-056c-4189-9205-098cf4f627e3","Type":"ContainerStarted","Data":"01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5"}
Jul 16 22:13:33.805466 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:33.805424    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:33.805693 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:33.805673    2563 patch_prober.go:28] interesting pod/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 16 22:13:33.805769 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:33.805750    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 16 22:13:34.805035 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:34.804993    2563 patch_prober.go:28] interesting pod/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 16 22:13:34.805457 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:34.805069    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 16 22:13:35.805489 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:35.805446    2563 patch_prober.go:28] interesting pod/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 16 22:13:35.805878 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:35.805537    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 16 22:13:36.494578 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:36.494542    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:13:36.805062 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:36.804978    2563 patch_prober.go:28] interesting pod/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 16 22:13:36.805062 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:36.805036    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 16 22:13:37.808616 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:37.808541    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:37.809143 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:37.808928    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:37.809531 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:37.809513    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:13:38.125592 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:38.125552    2563 generic.go:356] "Generic (PLEG): container finished" podID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerID="2100366372b67fa1b67962c31a84c712a62d605d002e03f6699470c6d640f3a6" exitCode=0
Jul 16 22:13:38.125799 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:38.125619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" event={"ID":"b5c21f7e-af46-4811-954e-30de0e7e367e","Type":"ContainerDied","Data":"2100366372b67fa1b67962c31a84c712a62d605d002e03f6699470c6d640f3a6"}
Jul 16 22:13:38.126186 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:38.126171    2563 scope.go:117] "RemoveContainer" containerID="2100366372b67fa1b67962c31a84c712a62d605d002e03f6699470c6d640f3a6"
Jul 16 22:13:38.127131 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:38.127103    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:38.127222 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:38.127185    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:38.127290 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:38.127227    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 16 22:13:39.147964 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:39.147900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" event={"ID":"b5c21f7e-af46-4811-954e-30de0e7e367e","Type":"ContainerStarted","Data":"9220ffbd4c77c7b8b7f518223c09a044995eda13138c182254a7a3ea9db4282e"}
Jul 16 22:13:39.281925 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:39.281884    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:39.282980 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:39.282958    2563 patch_prober.go:28] interesting pod/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 16 22:13:39.283063 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:39.283009    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 16 22:13:40.027672 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:40.027633    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:40.281507 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:40.281426    2563 patch_prober.go:28] interesting pod/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 16 22:13:40.281507 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:40.281483    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 16 22:13:41.281926 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:41.281885    2563 patch_prober.go:28] interesting pod/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 16 22:13:41.282345 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:41.281973    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 16 22:13:42.282104 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:42.282069    2563 patch_prober.go:28] interesting pod/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 16 22:13:42.282497 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:42.282129    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 16 22:13:43.286255 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:43.286222    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:13:43.287439 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:13:43.287417    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:14:01.103072 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:01.103034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:14:28.399135 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.399105    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"]
Jul 16 22:14:28.399574 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.399508    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f85ec989-65ad-49c4-987c-4ea3d62707b0" containerName="istio-proxy"
Jul 16 22:14:28.401548 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.401532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.404707 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.404681    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ff5f80\"/\"default-dockercfg-nk4tz\""
Jul 16 22:14:28.404832 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.404683    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-ff5f80\"/\"auth-test-model-ff5f80-kserve-self-signed-certs\""
Jul 16 22:14:28.404832 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.404688    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ff5f80\"/\"openshift-service-ca.crt\""
Jul 16 22:14:28.404832 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.404688    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-ff5f80\"/\"kube-root-ca.crt\""
Jul 16 22:14:28.413975 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.413922    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"]
Jul 16 22:14:28.422092 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.422063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-home\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.422278 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.422110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-tmp-dir\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.422278 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.422172    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rdqg\" (UniqueName: \"kubernetes.io/projected/dfb15084-894d-418e-9180-a50689744541-kube-api-access-9rdqg\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.422278 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.422221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-dshm\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.422500 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.422281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-model-cache\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.422500 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.422326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb15084-894d-418e-9180-a50689744541-tls-certs\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.523039 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.523007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-home\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.523039 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.523043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-tmp-dir\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.523263 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.523071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rdqg\" (UniqueName: \"kubernetes.io/projected/dfb15084-894d-418e-9180-a50689744541-kube-api-access-9rdqg\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.523263 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.523104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-dshm\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.523263 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.523160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-model-cache\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.523263 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.523203    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb15084-894d-418e-9180-a50689744541-tls-certs\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.523445 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.523413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-tmp-dir\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.523483 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.523451    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-home\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.523531 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.523516    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-model-cache\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.525521 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.525486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-dshm\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.525837 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.525819    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb15084-894d-418e-9180-a50689744541-tls-certs\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.530533 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.530512    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rdqg\" (UniqueName: \"kubernetes.io/projected/dfb15084-894d-418e-9180-a50689744541-kube-api-access-9rdqg\") pod \"auth-test-model-ff5f80-kserve-588f9c545f-hr5vd\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") " pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.710234 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.710203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:28.843138 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:28.843106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"]
Jul 16 22:14:28.844980 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:14:28.844953    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfb15084_894d_418e_9180_a50689744541.slice/crio-41ff7d0e244d6108923502d1a7adc7959c2cc0edc4ec16f3c634d888a039afb1 WatchSource:0}: Error finding container 41ff7d0e244d6108923502d1a7adc7959c2cc0edc4ec16f3c634d888a039afb1: Status 404 returned error can't find the container with id 41ff7d0e244d6108923502d1a7adc7959c2cc0edc4ec16f3c634d888a039afb1
Jul 16 22:14:29.425505 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:29.425470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd" event={"ID":"dfb15084-894d-418e-9180-a50689744541","Type":"ContainerStarted","Data":"f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e"}
Jul 16 22:14:29.425931 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:29.425520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd" event={"ID":"dfb15084-894d-418e-9180-a50689744541","Type":"ContainerStarted","Data":"41ff7d0e244d6108923502d1a7adc7959c2cc0edc4ec16f3c634d888a039afb1"}
Jul 16 22:14:29.443401 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:29.443353    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd" podStartSLOduration=1.44333621 podStartE2EDuration="1.44333621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:14:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:14:29.44312613 +0000 UTC m=+2134.268771472" watchObservedRunningTime="2026-07-16 22:14:29.44333621 +0000 UTC m=+2134.268981511"
Jul 16 22:14:32.585397 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:32.585354    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:14:38.710797 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:38.710759    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:38.711331 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:38.710856    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:38.723216 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:38.723194    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:39.498468 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:39.498441    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:14:46.811312 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:14:46.811233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:15:05.602030 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:15:05.601999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:15:25.188930 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:15:25.188890    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:15:44.685524 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:15:44.685490    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:16:02.890308 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:02.890273    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:16:18.287668 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:18.287584    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:16:30.079697 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:30.079665    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"]
Jul 16 22:16:34.385241 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:34.385207    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:16:45.100867 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.100796    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd" podUID="dfb15084-894d-418e-9180-a50689744541" containerName="main" containerID="cri-o://f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e" gracePeriod=45
Jul 16 22:16:45.361620 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.361563    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:16:45.510680 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.510646    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-dshm\") pod \"dfb15084-894d-418e-9180-a50689744541\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") "
Jul 16 22:16:45.510680 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.510685    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-model-cache\") pod \"dfb15084-894d-418e-9180-a50689744541\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") "
Jul 16 22:16:45.510929 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.510716    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-home\") pod \"dfb15084-894d-418e-9180-a50689744541\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") "
Jul 16 22:16:45.510929 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.510749    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rdqg\" (UniqueName: \"kubernetes.io/projected/dfb15084-894d-418e-9180-a50689744541-kube-api-access-9rdqg\") pod \"dfb15084-894d-418e-9180-a50689744541\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") "
Jul 16 22:16:45.510929 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.510777    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb15084-894d-418e-9180-a50689744541-tls-certs\") pod \"dfb15084-894d-418e-9180-a50689744541\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") "
Jul 16 22:16:45.510929 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.510808    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-tmp-dir\") pod \"dfb15084-894d-418e-9180-a50689744541\" (UID: \"dfb15084-894d-418e-9180-a50689744541\") "
Jul 16 22:16:45.511170 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.510995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-model-cache" (OuterVolumeSpecName: "model-cache") pod "dfb15084-894d-418e-9180-a50689744541" (UID: "dfb15084-894d-418e-9180-a50689744541"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:16:45.511170 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.511051    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-home" (OuterVolumeSpecName: "home") pod "dfb15084-894d-418e-9180-a50689744541" (UID: "dfb15084-894d-418e-9180-a50689744541"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:16:45.511170 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.511159    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-model-cache\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:16:45.511329 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.511179    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-home\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:16:45.511329 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.511168    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dfb15084-894d-418e-9180-a50689744541" (UID: "dfb15084-894d-418e-9180-a50689744541"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:16:45.513135 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.513102    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-dshm" (OuterVolumeSpecName: "dshm") pod "dfb15084-894d-418e-9180-a50689744541" (UID: "dfb15084-894d-418e-9180-a50689744541"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:16:45.513239 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.513151    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfb15084-894d-418e-9180-a50689744541-kube-api-access-9rdqg" (OuterVolumeSpecName: "kube-api-access-9rdqg") pod "dfb15084-894d-418e-9180-a50689744541" (UID: "dfb15084-894d-418e-9180-a50689744541"). InnerVolumeSpecName "kube-api-access-9rdqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:16:45.513281 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.513223    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfb15084-894d-418e-9180-a50689744541-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dfb15084-894d-418e-9180-a50689744541" (UID: "dfb15084-894d-418e-9180-a50689744541"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:16:45.611873 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.611796    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-dshm\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:16:45.611873 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.611831    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rdqg\" (UniqueName: \"kubernetes.io/projected/dfb15084-894d-418e-9180-a50689744541-kube-api-access-9rdqg\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:16:45.611873 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.611843    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfb15084-894d-418e-9180-a50689744541-tls-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:16:45.611873 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:45.611871    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfb15084-894d-418e-9180-a50689744541-tmp-dir\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:16:46.144296 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:46.144262    2563 generic.go:356] "Generic (PLEG): container finished" podID="dfb15084-894d-418e-9180-a50689744541" containerID="f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e" exitCode=0
Jul 16 22:16:46.144729 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:46.144310    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"
Jul 16 22:16:46.144729 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:46.144333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd" event={"ID":"dfb15084-894d-418e-9180-a50689744541","Type":"ContainerDied","Data":"f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e"}
Jul 16 22:16:46.144729 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:46.144372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd" event={"ID":"dfb15084-894d-418e-9180-a50689744541","Type":"ContainerDied","Data":"41ff7d0e244d6108923502d1a7adc7959c2cc0edc4ec16f3c634d888a039afb1"}
Jul 16 22:16:46.144729 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:46.144395    2563 scope.go:117] "RemoveContainer" containerID="f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e"
Jul 16 22:16:46.153984 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:46.153965    2563 scope.go:117] "RemoveContainer" containerID="f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e"
Jul 16 22:16:46.154253 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:16:46.154235    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e\": container with ID starting with f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e not found: ID does not exist" containerID="f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e"
Jul 16 22:16:46.154294 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:46.154262    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e"} err="failed to get container status \"f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e\": rpc error: code = NotFound desc = could not find container \"f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e\": container with ID starting with f1cf809c53b5b53a9d869d4316a21e0f8f6a41d4a4615c0583b9580c9ea9598e not found: ID does not exist"
Jul 16 22:16:46.162180 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:46.162158    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"]
Jul 16 22:16:46.164255 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:46.164235    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-ff5f80/auth-test-model-ff5f80-kserve-588f9c545f-hr5vd"]
Jul 16 22:16:47.673290 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:47.673260    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfb15084-894d-418e-9180-a50689744541" path="/var/lib/kubelet/pods/dfb15084-894d-418e-9180-a50689744541/volumes"
Jul 16 22:16:51.297184 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:16:51.297152    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:17:21.992418 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:17:21.992375    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:17:41.392172 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:17:41.392131    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:17:55.881132 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:17:55.881057    2563 scope.go:117] "RemoveContainer" containerID="168b5b06c4fb68bb3b9c0025d9e37cc7803a5c76bbe9bb96466fa9c2cd2ba5e3"
Jul 16 22:18:03.092698 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:03.092667    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:18:05.312472 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.312439    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"]
Jul 16 22:18:05.312859 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.312791    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfb15084-894d-418e-9180-a50689744541" containerName="main"
Jul 16 22:18:05.312859 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.312804    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfb15084-894d-418e-9180-a50689744541" containerName="main"
Jul 16 22:18:05.312932 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.312870    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfb15084-894d-418e-9180-a50689744541" containerName="main"
Jul 16 22:18:05.315926 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.315910    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.319675 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.319657    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5d61a3\"/\"kube-root-ca.crt\""
Jul 16 22:18:05.319806 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.319659    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5d61a3\"/\"rate-test-model-5d61a3-kserve-self-signed-certs\""
Jul 16 22:18:05.319806 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.319693    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5d61a3\"/\"openshift-service-ca.crt\""
Jul 16 22:18:05.319806 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.319747    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5d61a3\"/\"default-dockercfg-6w9vs\""
Jul 16 22:18:05.329236 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.329216    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"]
Jul 16 22:18:05.405472 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.405441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-tmp-dir\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.405472 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.405472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m82pr\" (UniqueName: \"kubernetes.io/projected/381842b6-6015-429f-a784-41698b6e7b13-kube-api-access-m82pr\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.405710 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.405581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-home\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.405710 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.405622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381842b6-6015-429f-a784-41698b6e7b13-tls-certs\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.405793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.405716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-model-cache\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.405793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.405761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-dshm\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.506599 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.506566    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-dshm\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.506793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.506605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-tmp-dir\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.506793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.506632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m82pr\" (UniqueName: \"kubernetes.io/projected/381842b6-6015-429f-a784-41698b6e7b13-kube-api-access-m82pr\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.506793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.506683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-home\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.506793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.506706    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381842b6-6015-429f-a784-41698b6e7b13-tls-certs\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.506793 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.506788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-model-cache\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.507109 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.507042    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-tmp-dir\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.507109 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.507087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-home\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.507217 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.507160    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-model-cache\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.509132 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.509110    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-dshm\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.509303 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.509286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381842b6-6015-429f-a784-41698b6e7b13-tls-certs\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.514657 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.514637    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m82pr\" (UniqueName: \"kubernetes.io/projected/381842b6-6015-429f-a784-41698b6e7b13-kube-api-access-m82pr\") pod \"rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") " pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.625328 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.625239    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:05.777328 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:05.777289    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"]
Jul 16 22:18:05.777721 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:18:05.777694    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod381842b6_6015_429f_a784_41698b6e7b13.slice/crio-0f28cbbf00409314c79e96482d322c97ddb2da84ff079a7f1ad32ff2acdb176e WatchSource:0}: Error finding container 0f28cbbf00409314c79e96482d322c97ddb2da84ff079a7f1ad32ff2acdb176e: Status 404 returned error can't find the container with id 0f28cbbf00409314c79e96482d322c97ddb2da84ff079a7f1ad32ff2acdb176e
Jul 16 22:18:06.574173 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:06.574134    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf" event={"ID":"381842b6-6015-429f-a784-41698b6e7b13","Type":"ContainerStarted","Data":"5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7"}
Jul 16 22:18:06.574173 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:06.574184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf" event={"ID":"381842b6-6015-429f-a784-41698b6e7b13","Type":"ContainerStarted","Data":"0f28cbbf00409314c79e96482d322c97ddb2da84ff079a7f1ad32ff2acdb176e"}
Jul 16 22:18:06.592261 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:06.592213    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf" podStartSLOduration=1.592198445 podStartE2EDuration="1.592198445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:18:06.590914528 +0000 UTC m=+2351.416559829" watchObservedRunningTime="2026-07-16 22:18:06.592198445 +0000 UTC m=+2351.417843761"
Jul 16 22:18:15.626023 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:15.625986    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:15.626503 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:15.626037    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:15.638785 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:15.638758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:16.638380 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:16.638352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:18:19.699381 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:19.699340    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:18:42.902889 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:18:42.902858    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:19:02.495701 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:02.495662    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:19:19.396557 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:19.396465    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:19:25.226875 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:25.226839    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"]
Jul 16 22:19:33.196390 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:33.196355    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7573-140428994111360"]
Jul 16 22:19:33.199689 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:33.199673    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7573-140428994111360"
Jul 16 22:19:33.204762 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:33.204738    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-szfpx\""
Jul 16 22:19:33.217810 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:33.217781    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7573-140428994111360"]
Jul 16 22:19:33.276063 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:33.276036    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk4fx\" (UniqueName: \"kubernetes.io/projected/ae2e9d5e-6bb0-4769-8893-053e1af7662d-kube-api-access-hk4fx\") pod \"test-curl-7573-140428994111360\" (UID: \"ae2e9d5e-6bb0-4769-8893-053e1af7662d\") " pod="openshift-ingress/test-curl-7573-140428994111360"
Jul 16 22:19:33.377499 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:33.377470    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk4fx\" (UniqueName: \"kubernetes.io/projected/ae2e9d5e-6bb0-4769-8893-053e1af7662d-kube-api-access-hk4fx\") pod \"test-curl-7573-140428994111360\" (UID: \"ae2e9d5e-6bb0-4769-8893-053e1af7662d\") " pod="openshift-ingress/test-curl-7573-140428994111360"
Jul 16 22:19:33.386529 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:33.386505    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk4fx\" (UniqueName: \"kubernetes.io/projected/ae2e9d5e-6bb0-4769-8893-053e1af7662d-kube-api-access-hk4fx\") pod \"test-curl-7573-140428994111360\" (UID: \"ae2e9d5e-6bb0-4769-8893-053e1af7662d\") " pod="openshift-ingress/test-curl-7573-140428994111360"
Jul 16 22:19:33.508218 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:33.508141    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7573-140428994111360"
Jul 16 22:19:33.646022 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:33.645996    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7573-140428994111360"]
Jul 16 22:19:33.647333 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:19:33.647303    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae2e9d5e_6bb0_4769_8893_053e1af7662d.slice/crio-e8e4c07546d2d4759efe4b953d33960f7c2c81b1149a7cf46ee0f9fd5ad49b40 WatchSource:0}: Error finding container e8e4c07546d2d4759efe4b953d33960f7c2c81b1149a7cf46ee0f9fd5ad49b40: Status 404 returned error can't find the container with id e8e4c07546d2d4759efe4b953d33960f7c2c81b1149a7cf46ee0f9fd5ad49b40
Jul 16 22:19:33.648665 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:33.648645    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 22:19:34.043532 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:34.043490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7573-140428994111360" event={"ID":"ae2e9d5e-6bb0-4769-8893-053e1af7662d","Type":"ContainerStarted","Data":"e8e4c07546d2d4759efe4b953d33960f7c2c81b1149a7cf46ee0f9fd5ad49b40"}
Jul 16 22:19:35.050887 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:35.050852    2563 generic.go:356] "Generic (PLEG): container finished" podID="ae2e9d5e-6bb0-4769-8893-053e1af7662d" containerID="3ad95e362b5ab93701b95eef40ba79037ceffd615cd366f8cc1b188244ca6db6" exitCode=0
Jul 16 22:19:35.051301 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:35.050909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7573-140428994111360" event={"ID":"ae2e9d5e-6bb0-4769-8893-053e1af7662d","Type":"ContainerDied","Data":"3ad95e362b5ab93701b95eef40ba79037ceffd615cd366f8cc1b188244ca6db6"}
Jul 16 22:19:36.213289 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:36.213268    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7573-140428994111360"
Jul 16 22:19:36.249458 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:36.249433    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7573-140428994111360_ae2e9d5e-6bb0-4769-8893-053e1af7662d/test-curl-7573-140428994111360/0.log"
Jul 16 22:19:36.274907 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:36.274882    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7573-140428994111360"]
Jul 16 22:19:36.278848 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:36.278823    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7573-140428994111360"]
Jul 16 22:19:36.302428 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:36.302397    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk4fx\" (UniqueName: \"kubernetes.io/projected/ae2e9d5e-6bb0-4769-8893-053e1af7662d-kube-api-access-hk4fx\") pod \"ae2e9d5e-6bb0-4769-8893-053e1af7662d\" (UID: \"ae2e9d5e-6bb0-4769-8893-053e1af7662d\") "
Jul 16 22:19:36.304531 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:36.304507    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae2e9d5e-6bb0-4769-8893-053e1af7662d-kube-api-access-hk4fx" (OuterVolumeSpecName: "kube-api-access-hk4fx") pod "ae2e9d5e-6bb0-4769-8893-053e1af7662d" (UID: "ae2e9d5e-6bb0-4769-8893-053e1af7662d"). InnerVolumeSpecName "kube-api-access-hk4fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:19:36.403493 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:36.403467    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk4fx\" (UniqueName: \"kubernetes.io/projected/ae2e9d5e-6bb0-4769-8893-053e1af7662d-kube-api-access-hk4fx\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:37.063115 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:37.063085    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8e4c07546d2d4759efe4b953d33960f7c2c81b1149a7cf46ee0f9fd5ad49b40"
Jul 16 22:19:37.063115 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:37.063100    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7573-140428994111360"
Jul 16 22:19:37.077242 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:19:37.077212    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7573-140428994111360\" is forbidden: User \"system:node:ip-10-0-142-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-142-10.ec2.internal' and this object" podUID="ae2e9d5e-6bb0-4769-8893-053e1af7662d" pod="openshift-ingress/test-curl-7573-140428994111360"
Jul 16 22:19:37.589771 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:37.589738    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:19:37.674055 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:37.674023    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae2e9d5e-6bb0-4769-8893-053e1af7662d" path="/var/lib/kubelet/pods/ae2e9d5e-6bb0-4769-8893-053e1af7662d/volumes"
Jul 16 22:19:40.248024 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.247968    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf" podUID="381842b6-6015-429f-a784-41698b6e7b13" containerName="main" containerID="cri-o://5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7" gracePeriod=45
Jul 16 22:19:40.507691 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.507628    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:19:40.536138 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536106    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-home\") pod \"381842b6-6015-429f-a784-41698b6e7b13\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") "
Jul 16 22:19:40.536274 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536151    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-model-cache\") pod \"381842b6-6015-429f-a784-41698b6e7b13\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") "
Jul 16 22:19:40.536274 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536180    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m82pr\" (UniqueName: \"kubernetes.io/projected/381842b6-6015-429f-a784-41698b6e7b13-kube-api-access-m82pr\") pod \"381842b6-6015-429f-a784-41698b6e7b13\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") "
Jul 16 22:19:40.536274 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536244    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-tmp-dir\") pod \"381842b6-6015-429f-a784-41698b6e7b13\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") "
Jul 16 22:19:40.536274 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536268    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-dshm\") pod \"381842b6-6015-429f-a784-41698b6e7b13\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") "
Jul 16 22:19:40.536507 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536298    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381842b6-6015-429f-a784-41698b6e7b13-tls-certs\") pod \"381842b6-6015-429f-a784-41698b6e7b13\" (UID: \"381842b6-6015-429f-a784-41698b6e7b13\") "
Jul 16 22:19:40.536507 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536455    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-model-cache" (OuterVolumeSpecName: "model-cache") pod "381842b6-6015-429f-a784-41698b6e7b13" (UID: "381842b6-6015-429f-a784-41698b6e7b13"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:40.536507 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536472    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-home" (OuterVolumeSpecName: "home") pod "381842b6-6015-429f-a784-41698b6e7b13" (UID: "381842b6-6015-429f-a784-41698b6e7b13"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:40.536648 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536558    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "381842b6-6015-429f-a784-41698b6e7b13" (UID: "381842b6-6015-429f-a784-41698b6e7b13"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:40.536713 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536698    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-tmp-dir\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:40.536768 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536716    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-home\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:40.536768 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.536731    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-model-cache\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:40.538681 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.538648    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-dshm" (OuterVolumeSpecName: "dshm") pod "381842b6-6015-429f-a784-41698b6e7b13" (UID: "381842b6-6015-429f-a784-41698b6e7b13"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:40.538796 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.538723    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/381842b6-6015-429f-a784-41698b6e7b13-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "381842b6-6015-429f-a784-41698b6e7b13" (UID: "381842b6-6015-429f-a784-41698b6e7b13"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 22:19:40.538796 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.538724    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/381842b6-6015-429f-a784-41698b6e7b13-kube-api-access-m82pr" (OuterVolumeSpecName: "kube-api-access-m82pr") pod "381842b6-6015-429f-a784-41698b6e7b13" (UID: "381842b6-6015-429f-a784-41698b6e7b13"). InnerVolumeSpecName "kube-api-access-m82pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:19:40.637801 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.637767    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m82pr\" (UniqueName: \"kubernetes.io/projected/381842b6-6015-429f-a784-41698b6e7b13-kube-api-access-m82pr\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:40.637801 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.637793    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/381842b6-6015-429f-a784-41698b6e7b13-dshm\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:40.637801 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:40.637803    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381842b6-6015-429f-a784-41698b6e7b13-tls-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:41.084293 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:41.084257    2563 generic.go:356] "Generic (PLEG): container finished" podID="381842b6-6015-429f-a784-41698b6e7b13" containerID="5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7" exitCode=0
Jul 16 22:19:41.084293 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:41.084297    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"
Jul 16 22:19:41.084531 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:41.084337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf" event={"ID":"381842b6-6015-429f-a784-41698b6e7b13","Type":"ContainerDied","Data":"5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7"}
Jul 16 22:19:41.084531 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:41.084374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf" event={"ID":"381842b6-6015-429f-a784-41698b6e7b13","Type":"ContainerDied","Data":"0f28cbbf00409314c79e96482d322c97ddb2da84ff079a7f1ad32ff2acdb176e"}
Jul 16 22:19:41.084531 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:41.084391    2563 scope.go:117] "RemoveContainer" containerID="5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7"
Jul 16 22:19:41.094161 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:41.094144    2563 scope.go:117] "RemoveContainer" containerID="5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7"
Jul 16 22:19:41.094401 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:19:41.094385    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7\": container with ID starting with 5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7 not found: ID does not exist" containerID="5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7"
Jul 16 22:19:41.094467 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:41.094415    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7"} err="failed to get container status \"5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7\": rpc error: code = NotFound desc = could not find container \"5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7\": container with ID starting with 5905a0ff3736bb2c65c14bd904df292388b9b285489f8762743cf1cdc611ebc7 not found: ID does not exist"
Jul 16 22:19:41.106528 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:41.106506    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"]
Jul 16 22:19:41.110831 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:41.110812    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5d61a3/rate-test-model-5d61a3-kserve-74b96fbc9-sr5tf"]
Jul 16 22:19:41.673290 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:41.673254    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="381842b6-6015-429f-a784-41698b6e7b13" path="/var/lib/kubelet/pods/381842b6-6015-429f-a784-41698b6e7b13/volumes"
Jul 16 22:19:49.795641 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:49.795598    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:19:52.071377 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:52.071342    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"]
Jul 16 22:19:52.071771 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:52.071611    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy" containerID="cri-o://01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5" gracePeriod=30
Jul 16 22:19:52.811379 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:52.811344    2563 patch_prober.go:28] interesting pod/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 22:19:52.811549 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:52.811397    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 22:19:57.329970 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.329926    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:19:57.390181 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390103    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-socket\") pod \"7aaed010-056c-4189-9205-098cf4f627e3\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") "
Jul 16 22:19:57.390181 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390140    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aaed010-056c-4189-9205-098cf4f627e3-istio-podinfo\") pod \"7aaed010-056c-4189-9205-098cf4f627e3\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") "
Jul 16 22:19:57.390181 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390157    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aaed010-056c-4189-9205-098cf4f627e3-istiod-ca-cert\") pod \"7aaed010-056c-4189-9205-098cf4f627e3\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") "
Jul 16 22:19:57.390181 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390179    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-credential-socket\") pod \"7aaed010-056c-4189-9205-098cf4f627e3\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") "
Jul 16 22:19:57.390510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390242    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-certs\") pod \"7aaed010-056c-4189-9205-098cf4f627e3\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") "
Jul 16 22:19:57.390510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-envoy\") pod \"7aaed010-056c-4189-9205-098cf4f627e3\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") "
Jul 16 22:19:57.390510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390322    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-istio-token\") pod \"7aaed010-056c-4189-9205-098cf4f627e3\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") "
Jul 16 22:19:57.390510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390350    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-data\") pod \"7aaed010-056c-4189-9205-098cf4f627e3\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") "
Jul 16 22:19:57.390510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390387    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr5lv\" (UniqueName: \"kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-kube-api-access-zr5lv\") pod \"7aaed010-056c-4189-9205-098cf4f627e3\" (UID: \"7aaed010-056c-4189-9205-098cf4f627e3\") "
Jul 16 22:19:57.390510 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390389    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7aaed010-056c-4189-9205-098cf4f627e3" (UID: "7aaed010-056c-4189-9205-098cf4f627e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:57.390823 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390578    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7aaed010-056c-4189-9205-098cf4f627e3" (UID: "7aaed010-056c-4189-9205-098cf4f627e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:57.390823 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390603    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aaed010-056c-4189-9205-098cf4f627e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7aaed010-056c-4189-9205-098cf4f627e3" (UID: "7aaed010-056c-4189-9205-098cf4f627e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:19:57.390823 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390760    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7aaed010-056c-4189-9205-098cf4f627e3" (UID: "7aaed010-056c-4189-9205-098cf4f627e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:57.391180 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390821    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:57.391180 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390841    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7aaed010-056c-4189-9205-098cf4f627e3-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:57.391180 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.390855    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:57.391355 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.391333    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "7aaed010-056c-4189-9205-098cf4f627e3" (UID: "7aaed010-056c-4189-9205-098cf4f627e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:57.392664 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.392631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7aaed010-056c-4189-9205-098cf4f627e3" (UID: "7aaed010-056c-4189-9205-098cf4f627e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:19:57.392780 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.392699    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-kube-api-access-zr5lv" (OuterVolumeSpecName: "kube-api-access-zr5lv") pod "7aaed010-056c-4189-9205-098cf4f627e3" (UID: "7aaed010-056c-4189-9205-098cf4f627e3"). InnerVolumeSpecName "kube-api-access-zr5lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:19:57.392780 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.392700    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "7aaed010-056c-4189-9205-098cf4f627e3" (UID: "7aaed010-056c-4189-9205-098cf4f627e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:19:57.392780 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.392718    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7aaed010-056c-4189-9205-098cf4f627e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7aaed010-056c-4189-9205-098cf4f627e3" (UID: "7aaed010-056c-4189-9205-098cf4f627e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:19:57.491475 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.491445    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:57.491475 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.491471    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr5lv\" (UniqueName: \"kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-kube-api-access-zr5lv\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:57.491475 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.491480    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7aaed010-056c-4189-9205-098cf4f627e3-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:57.491708 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.491489    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:57.491708 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.491496    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7aaed010-056c-4189-9205-098cf4f627e3-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:57.491708 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:57.491504    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7aaed010-056c-4189-9205-098cf4f627e3-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:19:58.176812 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.176776    2563 generic.go:356] "Generic (PLEG): container finished" podID="7aaed010-056c-4189-9205-098cf4f627e3" containerID="01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5" exitCode=0
Jul 16 22:19:58.177031 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.176825    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"
Jul 16 22:19:58.177031 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.176866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" event={"ID":"7aaed010-056c-4189-9205-098cf4f627e3","Type":"ContainerDied","Data":"01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5"}
Jul 16 22:19:58.177031 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.176916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2" event={"ID":"7aaed010-056c-4189-9205-098cf4f627e3","Type":"ContainerDied","Data":"b9da211c4479c0c5f1c0e5887fe5d2638f0eb0666f9df30148dd9f0efa63832c"}
Jul 16 22:19:58.177031 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.176964    2563 scope.go:117] "RemoveContainer" containerID="01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5"
Jul 16 22:19:58.186168 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.186151    2563 scope.go:117] "RemoveContainer" containerID="43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c"
Jul 16 22:19:58.194307 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.194127    2563 scope.go:117] "RemoveContainer" containerID="01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5"
Jul 16 22:19:58.194307 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.194194    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"]
Jul 16 22:19:58.194414 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:19:58.194397    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5\": container with ID starting with 01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5 not found: ID does not exist" containerID="01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5"
Jul 16 22:19:58.194452 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.194425    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5"} err="failed to get container status \"01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5\": rpc error: code = NotFound desc = could not find container \"01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5\": container with ID starting with 01920e44301e8fccab0516cbffa9e91a90bc80c250598eecbc419a1e4255c4f5 not found: ID does not exist"
Jul 16 22:19:58.194452 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.194446    2563 scope.go:117] "RemoveContainer" containerID="43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c"
Jul 16 22:19:58.194671 ip-10-0-142-10 kubenswrapper[2563]: E0716 22:19:58.194652    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c\": container with ID starting with 43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c not found: ID does not exist" containerID="43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c"
Jul 16 22:19:58.194707 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.194677    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c"} err="failed to get container status \"43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c\": rpc error: code = NotFound desc = could not find container \"43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c\": container with ID starting with 43103561a8b0671f31257e97f4ac33323533e4e2de9d60dbdab1048470bc563c not found: ID does not exist"
Jul 16 22:19:58.198802 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:58.198780    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-5d61a3-openshift-default-7947b797f-bp8z2"]
Jul 16 22:19:59.055996 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:59.055967    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"]
Jul 16 22:19:59.056417 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:59.056170    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy" containerID="cri-o://9220ffbd4c77c7b8b7f518223c09a044995eda13138c182254a7a3ea9db4282e" gracePeriod=30
Jul 16 22:19:59.673037 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:19:59.673005    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aaed010-056c-4189-9205-098cf4f627e3" path="/var/lib/kubelet/pods/7aaed010-056c-4189-9205-098cf4f627e3/volumes"
Jul 16 22:20:01.795464 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:01.795423    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5nwtr"]
Jul 16 22:20:04.210532 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.210501    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" event={"ID":"b5c21f7e-af46-4811-954e-30de0e7e367e","Type":"ContainerDied","Data":"9220ffbd4c77c7b8b7f518223c09a044995eda13138c182254a7a3ea9db4282e"}
Jul 16 22:20:04.211028 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.210569    2563 scope.go:117] "RemoveContainer" containerID="2100366372b67fa1b67962c31a84c712a62d605d002e03f6699470c6d640f3a6"
Jul 16 22:20:04.211028 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.210499    2563 generic.go:356] "Generic (PLEG): container finished" podID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerID="9220ffbd4c77c7b8b7f518223c09a044995eda13138c182254a7a3ea9db4282e" exitCode=0
Jul 16 22:20:04.315308 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.315286    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:20:04.406077 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.406000    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qfzb2_5cf7b1da-f6a8-4fec-b894-27ab267e3c24/manager/0.log"
Jul 16 22:20:04.452370 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452344    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5c21f7e-af46-4811-954e-30de0e7e367e-istiod-ca-cert\") pod \"b5c21f7e-af46-4811-954e-30de0e7e367e\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") "
Jul 16 22:20:04.452532 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452403    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2gxq\" (UniqueName: \"kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-kube-api-access-k2gxq\") pod \"b5c21f7e-af46-4811-954e-30de0e7e367e\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") "
Jul 16 22:20:04.452532 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452426    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-data\") pod \"b5c21f7e-af46-4811-954e-30de0e7e367e\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") "
Jul 16 22:20:04.452532 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452461    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-socket\") pod \"b5c21f7e-af46-4811-954e-30de0e7e367e\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") "
Jul 16 22:20:04.452701 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452596    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-token\") pod \"b5c21f7e-af46-4811-954e-30de0e7e367e\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") "
Jul 16 22:20:04.452701 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452647    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-envoy\") pod \"b5c21f7e-af46-4811-954e-30de0e7e367e\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") "
Jul 16 22:20:04.452701 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452670    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-certs\") pod \"b5c21f7e-af46-4811-954e-30de0e7e367e\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") "
Jul 16 22:20:04.452701 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452698    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-credential-socket\") pod \"b5c21f7e-af46-4811-954e-30de0e7e367e\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") "
Jul 16 22:20:04.452907 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452730    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-podinfo\") pod \"b5c21f7e-af46-4811-954e-30de0e7e367e\" (UID: \"b5c21f7e-af46-4811-954e-30de0e7e367e\") "
Jul 16 22:20:04.452907 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452826    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5c21f7e-af46-4811-954e-30de0e7e367e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5c21f7e-af46-4811-954e-30de0e7e367e" (UID: "b5c21f7e-af46-4811-954e-30de0e7e367e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 22:20:04.453106 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.452968    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5c21f7e-af46-4811-954e-30de0e7e367e" (UID: "b5c21f7e-af46-4811-954e-30de0e7e367e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:20:04.453168 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.453142    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5c21f7e-af46-4811-954e-30de0e7e367e" (UID: "b5c21f7e-af46-4811-954e-30de0e7e367e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:20:04.453212 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.453163    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-certs\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:20:04.453212 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.453184    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5c21f7e-af46-4811-954e-30de0e7e367e-istiod-ca-cert\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:20:04.453426 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.453396    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5c21f7e-af46-4811-954e-30de0e7e367e" (UID: "b5c21f7e-af46-4811-954e-30de0e7e367e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:20:04.453668 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.453639    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5c21f7e-af46-4811-954e-30de0e7e367e" (UID: "b5c21f7e-af46-4811-954e-30de0e7e367e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:20:04.454921 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.454897    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5c21f7e-af46-4811-954e-30de0e7e367e" (UID: "b5c21f7e-af46-4811-954e-30de0e7e367e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:20:04.455044 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.454915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5c21f7e-af46-4811-954e-30de0e7e367e" (UID: "b5c21f7e-af46-4811-954e-30de0e7e367e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 22:20:04.455044 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.455009    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-kube-api-access-k2gxq" (OuterVolumeSpecName: "kube-api-access-k2gxq") pod "b5c21f7e-af46-4811-954e-30de0e7e367e" (UID: "b5c21f7e-af46-4811-954e-30de0e7e367e"). InnerVolumeSpecName "kube-api-access-k2gxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 22:20:04.455237 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.455223    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5c21f7e-af46-4811-954e-30de0e7e367e" (UID: "b5c21f7e-af46-4811-954e-30de0e7e367e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 22:20:04.521838 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.521815    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-brhs2_3f167065-ce40-4e17-aaa1-ca5e9ff01c18/manager/0.log"
Jul 16 22:20:04.554132 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.554113    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2gxq\" (UniqueName: \"kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-kube-api-access-k2gxq\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:20:04.554229 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.554134    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-data\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:20:04.554229 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.554144    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-workload-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:20:04.554229 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.554154    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-token\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:20:04.554229 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.554162    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-envoy\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:20:04.554229 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.554170    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5c21f7e-af46-4811-954e-30de0e7e367e-credential-socket\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:20:04.554229 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.554179    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5c21f7e-af46-4811-954e-30de0e7e367e-istio-podinfo\") on node \"ip-10-0-142-10.ec2.internal\" DevicePath \"\""
Jul 16 22:20:04.754926 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.754897    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6kzw6_5a6eddd3-0629-4e96-9611-dabfadc5a9b5/server/0.log"
Jul 16 22:20:04.871047 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:04.871019    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kgf9p_f5b750a5-b46e-416a-9b03-1f4c0f76814c/manager/0.log"
Jul 16 22:20:05.217039 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:05.217011    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"
Jul 16 22:20:05.217456 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:05.217039    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d" event={"ID":"b5c21f7e-af46-4811-954e-30de0e7e367e","Type":"ContainerDied","Data":"a52d27891e79a7dc947f31f0628d3df8524791bc5194316de61693b8fa7b8293"}
Jul 16 22:20:05.217456 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:05.217101    2563 scope.go:117] "RemoveContainer" containerID="9220ffbd4c77c7b8b7f518223c09a044995eda13138c182254a7a3ea9db4282e"
Jul 16 22:20:05.225977 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:05.225923    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-db5748bcb-qh7fr_1583df3d-dea4-4935-bc8d-d647981197de/copy-manifests/0.log"
Jul 16 22:20:05.232400 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:05.232381    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-db5748bcb-qh7fr_1583df3d-dea4-4935-bc8d-d647981197de/manager/0.log"
Jul 16 22:20:05.238789 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:05.238769    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"]
Jul 16 22:20:05.242835 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:05.242809    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-ff5f80-openshift-default-bb4645bc-vhh8d"]
Jul 16 22:20:05.680471 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:05.680380    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" path="/var/lib/kubelet/pods/b5c21f7e-af46-4811-954e-30de0e7e367e/volumes"
Jul 16 22:20:06.429216 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.429192    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w_849ade00-3944-418e-a2af-fcf8cc402926/pull/0.log"
Jul 16 22:20:06.436441 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.436417    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w_849ade00-3944-418e-a2af-fcf8cc402926/extract/0.log"
Jul 16 22:20:06.442777 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.442756    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w_849ade00-3944-418e-a2af-fcf8cc402926/util/0.log"
Jul 16 22:20:06.569790 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.569767    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2_4e6ace45-a35b-440a-8e0c-6e8c28b6782e/pull/0.log"
Jul 16 22:20:06.576761 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.576740    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2_4e6ace45-a35b-440a-8e0c-6e8c28b6782e/extract/0.log"
Jul 16 22:20:06.583372 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.583355    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2_4e6ace45-a35b-440a-8e0c-6e8c28b6782e/util/0.log"
Jul 16 22:20:06.697729 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.697701    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq_494b5a83-79e7-4225-a5de-35d7b6e60e63/util/0.log"
Jul 16 22:20:06.704043 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.704023    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq_494b5a83-79e7-4225-a5de-35d7b6e60e63/pull/0.log"
Jul 16 22:20:06.712862 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.712838    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq_494b5a83-79e7-4225-a5de-35d7b6e60e63/extract/0.log"
Jul 16 22:20:06.823081 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.823052    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx_1d10626c-cc9c-4d10-a10e-b5eb0a913903/pull/0.log"
Jul 16 22:20:06.829862 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.829844    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx_1d10626c-cc9c-4d10-a10e-b5eb0a913903/extract/0.log"
Jul 16 22:20:06.836250 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:06.836226    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx_1d10626c-cc9c-4d10-a10e-b5eb0a913903/util/0.log"
Jul 16 22:20:07.097177 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:07.097081    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-snmhq_d50219a4-f550-417b-8938-6e31500983cd/manager/0.log"
Jul 16 22:20:07.210048 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:07.210013    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kvvht_e9399775-c7f5-4149-a953-a645510e285c/manager/0.log"
Jul 16 22:20:07.317890 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:07.317863    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5tnlg_3ae88d7e-5117-442c-8d78-9fe3efc3d3ff/kuadrant-console-plugin/0.log"
Jul 16 22:20:07.431469 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:07.431441    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pqkcn_c20e4ae6-0e5f-4089-af28-9629f7fe07f3/registry-server/0.log"
Jul 16 22:20:07.671030 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:07.671002    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5nwtr_c4cbafe6-6676-4c91-845b-bbeaee7b14c4/limitador/0.log"
Jul 16 22:20:07.783409 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:07.783329    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-p4pdl_ffde85a2-a711-41ca-b802-512c4b7d9f99/manager/0.log"
Jul 16 22:20:08.115895 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:08.115808    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hcplq_6f08a02d-b6d3-4c9c-a39a-e329bec72562/istio-proxy/0.log"
Jul 16 22:20:08.340188 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:08.340159    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b5c5c797-9c75x_2fe08dd5-9fbb-4a04-aea2-663872bf0063/kube-auth-proxy/0.log"
Jul 16 22:20:08.563779 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:08.563742    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nwr4z_5905f494-56a5-4419-9bac-f370f36ee5d1/istio-proxy/1.log"
Jul 16 22:20:09.595381 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:09.595348    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbnnm7k_dfa03f5f-7ea1-444d-9e44-8952e5a2f55d/main/0.log"
Jul 16 22:20:13.787134 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787099    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qvtkv/must-gather-6sq9n"]
Jul 16 22:20:13.787585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787455    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy"
Jul 16 22:20:13.787585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787469    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy"
Jul 16 22:20:13.787585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787479    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy"
Jul 16 22:20:13.787585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787484    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy"
Jul 16 22:20:13.787585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787495    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae2e9d5e-6bb0-4769-8893-053e1af7662d" containerName="test-curl-7573-140428994111360"
Jul 16 22:20:13.787585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787501    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae2e9d5e-6bb0-4769-8893-053e1af7662d" containerName="test-curl-7573-140428994111360"
Jul 16 22:20:13.787585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787507    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy"
Jul 16 22:20:13.787585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787513    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy"
Jul 16 22:20:13.787585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787530    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381842b6-6015-429f-a784-41698b6e7b13" containerName="main"
Jul 16 22:20:13.787585 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787539    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="381842b6-6015-429f-a784-41698b6e7b13" containerName="main"
Jul 16 22:20:13.787888 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787592    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="381842b6-6015-429f-a784-41698b6e7b13" containerName="main"
Jul 16 22:20:13.787888 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787604    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae2e9d5e-6bb0-4769-8893-053e1af7662d" containerName="test-curl-7573-140428994111360"
Jul 16 22:20:13.787888 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787616    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy"
Jul 16 22:20:13.787888 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787622    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy"
Jul 16 22:20:13.787888 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787628    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy"
Jul 16 22:20:13.787888 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787687    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy"
Jul 16 22:20:13.787888 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787696    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c21f7e-af46-4811-954e-30de0e7e367e" containerName="istio-proxy"
Jul 16 22:20:13.787888 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.787745    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aaed010-056c-4189-9205-098cf4f627e3" containerName="istio-proxy"
Jul 16 22:20:13.791861 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.791843    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvtkv/must-gather-6sq9n"
Jul 16 22:20:13.794736 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.794709    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qvtkv\"/\"kube-root-ca.crt\""
Jul 16 22:20:13.795587 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.795567    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qvtkv\"/\"openshift-service-ca.crt\""
Jul 16 22:20:13.795687 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.795572    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qvtkv\"/\"default-dockercfg-bx2pd\""
Jul 16 22:20:13.798664 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.798645    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvtkv/must-gather-6sq9n"]
Jul 16 22:20:13.936786 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.936748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcgqq\" (UniqueName: \"kubernetes.io/projected/7b7a9d5e-d822-43f3-aae8-ecb5157e2460-kube-api-access-mcgqq\") pod \"must-gather-6sq9n\" (UID: \"7b7a9d5e-d822-43f3-aae8-ecb5157e2460\") " pod="openshift-must-gather-qvtkv/must-gather-6sq9n"
Jul 16 22:20:13.936983 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:13.936868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7b7a9d5e-d822-43f3-aae8-ecb5157e2460-must-gather-output\") pod \"must-gather-6sq9n\" (UID: \"7b7a9d5e-d822-43f3-aae8-ecb5157e2460\") " pod="openshift-must-gather-qvtkv/must-gather-6sq9n"
Jul 16 22:20:14.038070 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:14.037971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7b7a9d5e-d822-43f3-aae8-ecb5157e2460-must-gather-output\") pod \"must-gather-6sq9n\" (UID: \"7b7a9d5e-d822-43f3-aae8-ecb5157e2460\") " pod="openshift-must-gather-qvtkv/must-gather-6sq9n"
Jul 16 22:20:14.038070 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:14.038055    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcgqq\" (UniqueName: \"kubernetes.io/projected/7b7a9d5e-d822-43f3-aae8-ecb5157e2460-kube-api-access-mcgqq\") pod \"must-gather-6sq9n\" (UID: \"7b7a9d5e-d822-43f3-aae8-ecb5157e2460\") " pod="openshift-must-gather-qvtkv/must-gather-6sq9n"
Jul 16 22:20:14.038352 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:14.038328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7b7a9d5e-d822-43f3-aae8-ecb5157e2460-must-gather-output\") pod \"must-gather-6sq9n\" (UID: \"7b7a9d5e-d822-43f3-aae8-ecb5157e2460\") " pod="openshift-must-gather-qvtkv/must-gather-6sq9n"
Jul 16 22:20:14.046472 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:14.046446    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcgqq\" (UniqueName: \"kubernetes.io/projected/7b7a9d5e-d822-43f3-aae8-ecb5157e2460-kube-api-access-mcgqq\") pod \"must-gather-6sq9n\" (UID: \"7b7a9d5e-d822-43f3-aae8-ecb5157e2460\") " pod="openshift-must-gather-qvtkv/must-gather-6sq9n"
Jul 16 22:20:14.102608 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:14.102581    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvtkv/must-gather-6sq9n"
Jul 16 22:20:14.238528 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:14.238501    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvtkv/must-gather-6sq9n"]
Jul 16 22:20:14.240659 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:20:14.240635    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b7a9d5e_d822_43f3_aae8_ecb5157e2460.slice/crio-4990f78a22679ec0eadb5d739e0e88882dca3529711c8fd3e18178e0eed94232 WatchSource:0}: Error finding container 4990f78a22679ec0eadb5d739e0e88882dca3529711c8fd3e18178e0eed94232: Status 404 returned error can't find the container with id 4990f78a22679ec0eadb5d739e0e88882dca3529711c8fd3e18178e0eed94232
Jul 16 22:20:14.276002 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:14.275967    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvtkv/must-gather-6sq9n" event={"ID":"7b7a9d5e-d822-43f3-aae8-ecb5157e2460","Type":"ContainerStarted","Data":"4990f78a22679ec0eadb5d739e0e88882dca3529711c8fd3e18178e0eed94232"}
Jul 16 22:20:16.289453 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:16.289419    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvtkv/must-gather-6sq9n" event={"ID":"7b7a9d5e-d822-43f3-aae8-ecb5157e2460","Type":"ContainerStarted","Data":"43c38d64de2c6495830259c97562f960d1816c097a71985150eeff83f8a2c268"}
Jul 16 22:20:16.289958 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:16.289508    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvtkv/must-gather-6sq9n" event={"ID":"7b7a9d5e-d822-43f3-aae8-ecb5157e2460","Type":"ContainerStarted","Data":"a158911ec4edd05ff61c2e2379a64bb2dd00a8141f4e9fc35759f363a04b03fb"}
Jul 16 22:20:16.305438 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:16.305316    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qvtkv/must-gather-6sq9n" podStartSLOduration=2.283016309 podStartE2EDuration="3.30529425s" totalImagesPullingTime="1.022277941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 22:20:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:20:16.304494791 +0000 UTC m=+2481.130140091" watchObservedRunningTime="2026-07-16 22:20:16.30529425 +0000 UTC m=+2481.130939551"
Jul 16 22:20:16.886505 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:16.886467    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-whqdq_21308f42-77e5-4c41-bc85-caa29a85bafa/global-pull-secret-syncer/0.log"
Jul 16 22:20:16.976625 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:16.976596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gj8cl_d1edc691-c0b6-4126-b0cf-2f9e9c7fea1a/konnectivity-agent/0.log"
Jul 16 22:20:17.128463 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:17.128438    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-10.ec2.internal_4e0787be98d7ff323b91c421748cde82/haproxy/0.log"
Jul 16 22:20:21.836997 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:21.836959    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w_849ade00-3944-418e-a2af-fcf8cc402926/extract/0.log"
Jul 16 22:20:21.866673 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:21.866640    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w_849ade00-3944-418e-a2af-fcf8cc402926/util/0.log"
Jul 16 22:20:21.888660 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:21.888621    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759wjn6w_849ade00-3944-418e-a2af-fcf8cc402926/pull/0.log"
Jul 16 22:20:21.935799 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:21.935755    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2_4e6ace45-a35b-440a-8e0c-6e8c28b6782e/extract/0.log"
Jul 16 22:20:21.964856 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:21.964826    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2_4e6ace45-a35b-440a-8e0c-6e8c28b6782e/util/0.log"
Jul 16 22:20:21.988782 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:21.988719    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0d42t2_4e6ace45-a35b-440a-8e0c-6e8c28b6782e/pull/0.log"
Jul 16 22:20:22.021898 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:22.021858    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq_494b5a83-79e7-4225-a5de-35d7b6e60e63/extract/0.log"
Jul 16 22:20:22.049755 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:22.049729    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq_494b5a83-79e7-4225-a5de-35d7b6e60e63/util/0.log"
Jul 16 22:20:22.078515 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:22.078475    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735nxdq_494b5a83-79e7-4225-a5de-35d7b6e60e63/pull/0.log"
Jul 16 22:20:22.111878 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:22.111782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx_1d10626c-cc9c-4d10-a10e-b5eb0a913903/extract/0.log"
Jul 16 22:20:22.141050 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:22.141024    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx_1d10626c-cc9c-4d10-a10e-b5eb0a913903/util/0.log"
Jul 16 22:20:22.167475 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:22.167419    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1v8ktx_1d10626c-cc9c-4d10-a10e-b5eb0a913903/pull/0.log"
Jul 16 22:20:22.726486 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:22.726459    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-snmhq_d50219a4-f550-417b-8938-6e31500983cd/manager/0.log"
Jul 16 22:20:22.766896 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:22.766872    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kvvht_e9399775-c7f5-4149-a953-a645510e285c/manager/0.log"
Jul 16 22:20:22.800623 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:22.800598    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-5tnlg_3ae88d7e-5117-442c-8d78-9fe3efc3d3ff/kuadrant-console-plugin/0.log"
Jul 16 22:20:22.857093 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:22.857063    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-pqkcn_c20e4ae6-0e5f-4089-af28-9629f7fe07f3/registry-server/0.log"
Jul 16 22:20:23.035785 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:23.035708    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5nwtr_c4cbafe6-6676-4c91-845b-bbeaee7b14c4/limitador/0.log"
Jul 16 22:20:23.112434 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:23.112263    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-p4pdl_ffde85a2-a711-41ca-b802-512c4b7d9f99/manager/0.log"
Jul 16 22:20:24.927778 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:24.927748    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48czs_b0b98089-e1ff-4f51-bb88-95d81377d251/node-exporter/0.log"
Jul 16 22:20:24.960081 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:24.960055    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48czs_b0b98089-e1ff-4f51-bb88-95d81377d251/kube-rbac-proxy/0.log"
Jul 16 22:20:24.984230 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:24.984196    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-48czs_b0b98089-e1ff-4f51-bb88-95d81377d251/init-textfile/0.log"
Jul 16 22:20:26.864344 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:26.864305    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"]
Jul 16 22:20:26.870229 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:26.870201    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:26.880224 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:26.880183    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"]
Jul 16 22:20:26.993424 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:26.993391    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-lib-modules\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:26.993694 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:26.993676    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-proc\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:26.993872 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:26.993854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f5vq\" (UniqueName: \"kubernetes.io/projected/c5305eed-6948-42f3-90da-6c789587e5b9-kube-api-access-7f5vq\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:26.994045 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:26.994018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-sys\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:26.994163 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:26.994058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-podres\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.094923 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.094889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f5vq\" (UniqueName: \"kubernetes.io/projected/c5305eed-6948-42f3-90da-6c789587e5b9-kube-api-access-7f5vq\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.094923 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.094929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-sys\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.095200 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.094971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-podres\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.095200 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.095071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-lib-modules\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.095200 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.095097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-sys\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.095200 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.095101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-proc\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.095200 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.095150    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-proc\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.095373 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.095263    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-lib-modules\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.095411 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.095395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5305eed-6948-42f3-90da-6c789587e5b9-podres\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.105239 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.105209    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f5vq\" (UniqueName: \"kubernetes.io/projected/c5305eed-6948-42f3-90da-6c789587e5b9-kube-api-access-7f5vq\") pod \"perf-node-gather-daemonset-k7mnc\" (UID: \"c5305eed-6948-42f3-90da-6c789587e5b9\") " pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.186673 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.186433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:27.375097 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:27.375018    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"]
Jul 16 22:20:27.378604 ip-10-0-142-10 kubenswrapper[2563]: W0716 22:20:27.377492    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc5305eed_6948_42f3_90da_6c789587e5b9.slice/crio-c9079a27606c44a68690bb7ce018c2c5a009642af0911080bb0822a5f658f415 WatchSource:0}: Error finding container c9079a27606c44a68690bb7ce018c2c5a009642af0911080bb0822a5f658f415: Status 404 returned error can't find the container with id c9079a27606c44a68690bb7ce018c2c5a009642af0911080bb0822a5f658f415
Jul 16 22:20:28.396639 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:28.396595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc" event={"ID":"c5305eed-6948-42f3-90da-6c789587e5b9","Type":"ContainerStarted","Data":"4afe8b9ba5e1d7028bf19cf6472fd8cb95a9884cd1af6ef1b23d0008b075beaa"}
Jul 16 22:20:28.397174 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:28.396692    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc" event={"ID":"c5305eed-6948-42f3-90da-6c789587e5b9","Type":"ContainerStarted","Data":"c9079a27606c44a68690bb7ce018c2c5a009642af0911080bb0822a5f658f415"}
Jul 16 22:20:28.397174 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:28.396990    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:28.413954 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:28.413899    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc" podStartSLOduration=2.413882702 podStartE2EDuration="2.413882702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 22:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 22:20:28.412642918 +0000 UTC m=+2493.238288219" watchObservedRunningTime="2026-07-16 22:20:28.413882702 +0000 UTC m=+2493.239528002"
Jul 16 22:20:29.761511 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:29.761484    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-62fs8_a55ec89b-bbf5-46c8-a148-4cefc15a983a/dns/0.log"
Jul 16 22:20:29.785238 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:29.785214    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-62fs8_a55ec89b-bbf5-46c8-a148-4cefc15a983a/kube-rbac-proxy/0.log"
Jul 16 22:20:29.934787 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:29.934756    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8bjzh_264493e6-1304-4d77-83e8-dc20b5a46aa2/dns-node-resolver/0.log"
Jul 16 22:20:30.498895 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:30.498858    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7bd9844569-gxg48_667d6bfa-9e35-406e-b763-08911de18315/registry/0.log"
Jul 16 22:20:30.520985 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:30.520930    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-chlpb_6ac8ce73-91e1-4c61-9901-8f1be334b08a/node-ca/0.log"
Jul 16 22:20:31.508573 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:31.508536    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hcplq_6f08a02d-b6d3-4c9c-a39a-e329bec72562/istio-proxy/0.log"
Jul 16 22:20:31.729563 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:31.729532    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b5c5c797-9c75x_2fe08dd5-9fbb-4a04-aea2-663872bf0063/kube-auth-proxy/0.log"
Jul 16 22:20:31.785015 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:31.784928    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nwr4z_5905f494-56a5-4419-9bac-f370f36ee5d1/istio-proxy/0.log"
Jul 16 22:20:31.826963 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:31.826908    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nwr4z_5905f494-56a5-4419-9bac-f370f36ee5d1/istio-proxy/1.log"
Jul 16 22:20:32.604324 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:32.604297    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fxp5t_8a3f228b-9839-4b30-9763-be6bd3b963e2/serve-healthcheck-canary/0.log"
Jul 16 22:20:33.151082 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:33.151059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9j2bz_43b83dcc-467a-46cb-b704-8e7fe5f93e2a/kube-rbac-proxy/0.log"
Jul 16 22:20:33.172853 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:33.172828    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9j2bz_43b83dcc-467a-46cb-b704-8e7fe5f93e2a/exporter/0.log"
Jul 16 22:20:33.197322 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:33.197259    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9j2bz_43b83dcc-467a-46cb-b704-8e7fe5f93e2a/extractor/0.log"
Jul 16 22:20:34.417258 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:34.417228    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qvtkv/perf-node-gather-daemonset-k7mnc"
Jul 16 22:20:35.519455 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:35.519427    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-qfzb2_5cf7b1da-f6a8-4fec-b894-27ab267e3c24/manager/0.log"
Jul 16 22:20:35.694712 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:35.694672    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-brhs2_3f167065-ce40-4e17-aaa1-ca5e9ff01c18/manager/0.log"
Jul 16 22:20:35.883955 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:35.883889    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-6kzw6_5a6eddd3-0629-4e96-9611-dabfadc5a9b5/server/0.log"
Jul 16 22:20:35.967062 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:35.966970    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-kgf9p_f5b750a5-b46e-416a-9b03-1f4c0f76814c/manager/0.log"
Jul 16 22:20:36.214964 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:36.214896    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-db5748bcb-qh7fr_1583df3d-dea4-4935-bc8d-d647981197de/manager/0.log"
Jul 16 22:20:36.239267 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:36.239189    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-db5748bcb-qh7fr_1583df3d-dea4-4935-bc8d-d647981197de/copy-manifests/0.log"
Jul 16 22:20:37.241380 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:37.241348    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hcplq_6f08a02d-b6d3-4c9c-a39a-e329bec72562/istio-proxy/0.log"
Jul 16 22:20:37.437272 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:37.437248    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b5c5c797-9c75x_2fe08dd5-9fbb-4a04-aea2-663872bf0063/kube-auth-proxy/0.log"
Jul 16 22:20:37.474882 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:37.474859    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nwr4z_5905f494-56a5-4419-9bac-f370f36ee5d1/istio-proxy/0.log"
Jul 16 22:20:37.513035 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:37.512999    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nwr4z_5905f494-56a5-4419-9bac-f370f36ee5d1/istio-proxy/1.log"
Jul 16 22:20:37.547259 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:37.547230    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-m4fck_40015843-3759-4852-8832-0343a13facdb/openshift-lws-operator/0.log"
Jul 16 22:20:38.926313 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:38.926275    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4hcplq_6f08a02d-b6d3-4c9c-a39a-e329bec72562/istio-proxy/0.log"
Jul 16 22:20:39.124238 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:39.124155    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67b5c5c797-9c75x_2fe08dd5-9fbb-4a04-aea2-663872bf0063/kube-auth-proxy/0.log"
Jul 16 22:20:39.161895 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:39.161858    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nwr4z_5905f494-56a5-4419-9bac-f370f36ee5d1/istio-proxy/0.log"
Jul 16 22:20:39.202043 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:39.201997    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-nwr4z_5905f494-56a5-4419-9bac-f370f36ee5d1/istio-proxy/1.log"
Jul 16 22:20:42.409340 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:42.409309    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-r749n_caddea97-5475-45a6-a7b0-4054679512e1/migrator/0.log"
Jul 16 22:20:42.432466 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:42.432431    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-r749n_caddea97-5475-45a6-a7b0-4054679512e1/graceful-termination/0.log"
Jul 16 22:20:43.804725 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:43.804702    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gp999_37897c5f-4e5e-47a1-890c-010bdeb4877a/kube-multus-additional-cni-plugins/0.log"
Jul 16 22:20:43.826670 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:43.826649    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gp999_37897c5f-4e5e-47a1-890c-010bdeb4877a/egress-router-binary-copy/0.log"
Jul 16 22:20:43.850155 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:43.850111    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gp999_37897c5f-4e5e-47a1-890c-010bdeb4877a/cni-plugins/0.log"
Jul 16 22:20:43.872448 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:43.872409    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gp999_37897c5f-4e5e-47a1-890c-010bdeb4877a/bond-cni-plugin/0.log"
Jul 16 22:20:43.894979 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:43.894927    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gp999_37897c5f-4e5e-47a1-890c-010bdeb4877a/routeoverride-cni/0.log"
Jul 16 22:20:43.920391 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:43.920360    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gp999_37897c5f-4e5e-47a1-890c-010bdeb4877a/whereabouts-cni-bincopy/0.log"
Jul 16 22:20:43.948113 ip-10-0-142-10 kubenswrapper[2563]: I0716 22:20:43.948042    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gp999_37897c5f-4e5e-47a1-890c-010bdeb4877a/whereabouts-cni/0.log"