Jul 07 16:18:25.378526 ip-10-0-136-99 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.821474    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829699    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829711    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829714    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829717    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829721    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829723    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829726    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:25.999027 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829728    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829731    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829733    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829736    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829739    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829741    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829744    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829747    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829755    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829758    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829763    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829767    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829772    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829776    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829779    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829782    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829784    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829787    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829789    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:26.001916 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829792    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:25.903681 ip-10-0-136-99 systemd[1]: Started Kubernetes Kubelet.
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829795    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829797    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829800    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829803    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829805    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829808    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829810    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829812    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829815    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829817    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829820    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829823    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829825    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829828    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829830    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829833    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829836    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829838    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829842    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:26.006411 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829844    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829847    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829849    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829852    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829855    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829857    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829860    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829862    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829865    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829867    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829870    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829872    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829877    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829880    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829883    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829886    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829888    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829891    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829894    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:26.007229 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829896    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829899    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829901    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829903    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829906    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829910    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829913    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829916    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829919    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829922    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829925    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829927    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829931    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829934    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829937    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829939    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829942    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829944    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829947    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829950    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:26.008102 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829952    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829954    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829957    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829960    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829962    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829965    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829967    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829970    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829972    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829975    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829977    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829980    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829982    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.829985    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830685    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830691    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830695    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830698    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830701    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830705    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:26.008742 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830710    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830713    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830718    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830721    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830725    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830728    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830731    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830734    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830737    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830740    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830743    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830745    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830748    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830751    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830753    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830756    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830758    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830761    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830763    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:26.009464 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830766    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830769    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830773    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830776    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830778    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830781    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830783    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830786    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830789    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830791    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830795    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830797    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830800    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830802    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830805    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830807    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830810    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830813    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830815    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830818    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:26.010049 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830820    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830823    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830826    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830828    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830831    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830833    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830835    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830838    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830840    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830843    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830845    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830847    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830850    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830852    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830855    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830858    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830860    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830862    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830865    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830868    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:26.010872 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830870    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830872    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830875    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830878    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830881    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830883    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830886    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830889    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830892    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830894    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830897    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830902    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830905    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830908    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830910    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830913    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830915    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830918    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830920    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830923    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:26.011605 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830925    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830928    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830930    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830933    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830935    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830938    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830940    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830943    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830945    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830948    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830950    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830953    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830955    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.830958    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831330    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831336    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831339    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831343    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831345    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:26.035231 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831348    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831351    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831354    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831356    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831361    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831364    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831367    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831370    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831373    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831376    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831378    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831381    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831383    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831386    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831388    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831390    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831393    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831396    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831398    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831401    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:26.035892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831403    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831405    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831408    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831411    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831413    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831416    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831418    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831421    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831424    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831426    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831429    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831431    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831434    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831438    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831441    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831443    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831448    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831450    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831453    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831456    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:26.036712 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831458    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831461    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831463    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831466    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831468    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831471    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831473    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831476    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831480    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831483    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831487    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831489    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831492    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831495    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831498    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831500    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831503    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831505    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831508    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831510    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:26.037289 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831513    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831515    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831518    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831520    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831522    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831526    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831529    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831532    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831537    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831540    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831543    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831546    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831549    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831553    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831556    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831558    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831561    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831563    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831566    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:26.038125 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831568    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831571    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831573    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831576    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831578    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831581    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831583    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831586    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831588    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831591    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831593    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831596    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831599    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831601    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.831603    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831670    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831681    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831686    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831692    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831696    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831699    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831704    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 16:18:26.038673 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831708    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831711    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831714    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831717    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831721    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831724    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831727    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831729    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831732    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831735    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831738    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831742    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831745    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831748    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831751    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831754    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831758    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831761    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831764    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831767    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831770    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831773    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831777    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831780    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 16:18:26.039445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831782    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831787    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831789    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831792    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831796    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831799    2563 flags.go:64] FLAG: --enable-server="true"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831802    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831809    2563 flags.go:64] FLAG: --event-burst="100"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831812    2563 flags.go:64] FLAG: --event-qps="50"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831823    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831827    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831830    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831834    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831838    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831841    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831844    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831847    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831850    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831852    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831855    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831858    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831861    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831864    2563 flags.go:64] FLAG: --feature-gates=""
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831868    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831871    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 16:18:26.040118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831873    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831876    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831879    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831882    2563 flags.go:64] FLAG: --help="false"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831885    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-136-99.ec2.internal"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831888    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831891    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831894    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831898    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831901    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831904    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831908    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831911    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831914    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831918    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831921    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831924    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831927    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831930    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831932    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831935    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831938    2563 flags.go:64] FLAG: --lock-file=""
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831941    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831944    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 16:18:26.040995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831947    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831952    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831955    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831958    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831961    2563 flags.go:64] FLAG: --logging-format="text"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831964    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831968    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831970    2563 flags.go:64] FLAG: --manifest-url=""
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831973    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831977    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831980    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831984    2563 flags.go:64] FLAG: --max-pods="110"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831987    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831990    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831993    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831996    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.831999    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832002    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832005    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832013    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832016    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832019    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832023    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 07 16:18:26.041692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832026    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832031    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832034    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832037    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832040    2563 flags.go:64] FLAG: --port="10250"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832043    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832046    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a8d9ea83684377a7"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832049    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832053    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832056    2563 flags.go:64] FLAG: --register-node="true"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832059    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832062    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832065    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832068    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832070    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832074    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832076    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832079    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832082    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832084    2563 flags.go:64] FLAG: --runonce="false"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832087    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832090    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832093    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832096    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832098    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832101    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 16:18:26.042553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832104    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832107    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832110    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832113    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832116    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832120    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832123    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832126    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832129    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832134    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832136    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832139    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832143    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832146    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832149    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832152    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832155    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832158    2563 flags.go:64] FLAG: --v="2"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832161    2563 flags.go:64] FLAG: --version="false"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832165    2563 flags.go:64] FLAG: --vmodule=""
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832168    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832171    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832299    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832303    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:26.043310 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832306    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832309    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832312    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832314    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832317    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832319    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832322    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832324    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832327    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832330    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832332    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832336    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832338    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832343    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832345    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832348    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832350    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832353    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832356    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832358    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:26.120315 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832361    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832364    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832366    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832369    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832372    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832374    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832377    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832379    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832382    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832384    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832386    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832389    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832393    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832397    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832400    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832403    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832405    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832408    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832410    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:26.141564 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832413    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832417    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832420    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832424    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832428    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832431    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832435    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832438    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832441    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832443    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832446    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832449    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832451    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832454    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832456    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832459    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832461    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832465    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832467    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:26.143972 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832470    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832472    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832474    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832477    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832479    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832482    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832484    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832487    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832489    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832492    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832494    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832496    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832499    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832501    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832504    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832506    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832509    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832513    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832516    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832520    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:26.144815 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832523    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832525    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832528    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832530    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832533    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832536    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832539    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832541    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832545    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832548    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832551    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832554    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832557    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832559    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832562    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832564    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832567    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832569    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:26.146700 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.832571    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.832577    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.842091    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.842106    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.842119    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.842125    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842185    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842190    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842193    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842196    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842200    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842203    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842208    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842213    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842215    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:26.147548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842218    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842220    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842223    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842227    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842231    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842233    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842236    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842239    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842242    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842244    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842247    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842265    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842268    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842271    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842274    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842276    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842279    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842282    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842284    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842287    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:26.150304 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842290    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842294    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842298    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842301    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842303    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842306    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842309    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842312    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842315    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842320    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842324    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842327    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842330    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842332    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842335    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842338    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842343    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842345    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842348    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:26.150933 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842351    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842354    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842357    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842359    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842362    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842364    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842366    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842369    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842372    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842374    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842376    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842379    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842382    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842384    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842387    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842389    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842391    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842394    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842396    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842399    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:26.151828 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842401    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842404    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842408    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842412    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842414    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842417    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842419    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842422    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842425    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842428    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842430    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842436    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842439    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842441    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842444    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842446    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842448    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842451    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842453    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:26.152425 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842456    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842458    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842461    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842464    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842466    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842469    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842471    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842474    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842476    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842479    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842482    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842484    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.842489    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842601    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842605    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842608    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 16:18:26.152965 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842613    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842616    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842619    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842621    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842624    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842626    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842629    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842631    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842634    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842637    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842640    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842642    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842645    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842648    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842651    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842653    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842656    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842658    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842661    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842664    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 16:18:26.153720 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842666    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842669    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842671    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842674    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842676    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842679    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842682    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842684    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842687    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842689    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842692    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842695    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842699    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842702    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842704    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842707    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842709    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842712    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842714    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842717    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 16:18:26.154309 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842720    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842722    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842726    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842728    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842731    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842733    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842736    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842738    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842741    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842744    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842748    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842751    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842754    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842756    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842759    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842761    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842764    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842766    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842769    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842771    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 16:18:26.154885 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842774    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842776    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842779    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842782    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842788    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842790    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842794    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842798    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842801    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842803    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842806    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842809    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842812    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842814    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842817    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842820    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842823    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842826    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842828    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 16:18:26.155606 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842831    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842833    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842836    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842838    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842841    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842843    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842847    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842851    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842854    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842857    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842860    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842862    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842865    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842867    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842870    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842872    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 16:18:26.156520 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:25.842874    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.842881    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.842987    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.845446    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.847189    2563 server.go:1019] "Starting client certificate rotation"
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.847287    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.847319    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.849951    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.854193    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.863593    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.867177    2563 log.go:25] "Validated CRI v1 image API"
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.868744    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 16:18:26.247955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.871386    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 85ddd481-981e-4ca6-b9bb-0fd39a809aa4:/dev/nvme0n1p4 fcf044c9-8c87-4fd3-9ee3-4d602200064a:/dev/nvme0n1p3]
Jul 07 16:18:26.248385 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.871406    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 16:18:26.248385 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.879134    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.879986    2563 manager.go:216] Machine: {Timestamp:2026-07-07 16:18:25.878589792 +0000 UTC m=+0.383459621 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099774 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec235f11626293193b83b327fb759686 SystemUUID:ec235f11-6262-9319-3b83-b327fb759686 BootID:bb843b7f-1b79-427d-9fa3-785fe4ff91b0 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:56:d1:13:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:56:d1:13:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:c1:94:fb:31:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.880083    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.880160    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.883597    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.883625    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-99.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.884405    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.884415    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.884422    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.885271    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.887137    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.891840    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.891963    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.891991    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.892004    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.892022    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.892034    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.892048    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 16:18:26.250527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.892474    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.892489    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.894790    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.897187    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.897214    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898668    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898692    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898704    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898713    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898722    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898728    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898735    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898740    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898746    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898751    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898784    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.898790    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.899671    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.899684    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:25.901669    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:25.901709    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.901777    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-99.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.902836    2563 server.go:1268] "Started kubelet"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.902946    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.902947    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.903021    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.905067    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.905220    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.907122    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-526qm"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:25.908907    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:25.907994    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-99.ec2.internal.18c00e3c9b2ac49f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-99.ec2.internal,UID:ip-10-0-136-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-99.ec2.internal,},FirstTimestamp:2026-07-07 16:18:25.902814367 +0000 UTC m=+0.407684198,LastTimestamp:2026-07-07 16:18:25.902814367 +0000 UTC m=+0.407684198,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-99.ec2.internal,}"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.913695    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-526qm"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.982364    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.982407    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:25.982595    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.983168    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.983168    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.983197    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.983366    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.983378    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 16:18:26.350155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.983875    2563 factory.go:55] Registering systemd factory
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.983895    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.984101    2563 factory.go:153] Registering CRI-O factory
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.984113    2563 factory.go:223] Registration of the crio container factory successfully
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.984170    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.984193    2563 factory.go:103] Registering Raw factory
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.984208    2563 manager.go:1196] Started watching for new ooms in manager
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.984671    2563 manager.go:349] Starting recovery of all containers
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.993352    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:25.997853    2563 manager.go:354] Recovery completed
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:25.999846    2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-99.ec2.internal\" not found" node="ip-10-0-136-99.ec2.internal"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.002105    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.005643    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.005760    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.005771    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.006766    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.006775    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.006789    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.006821    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.007504    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.007534    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.007550    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.008961    2563 policy_none.go:49] "None policy: Start"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.008974    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.008984    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.010920    2563 policy_none.go:47] "Start"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:26.083276    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.095934    2563 manager.go:337] "Starting Device Plugin manager"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:26.095970    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.095982    2563 server.go:87] "Starting device plugin registration server"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.096247    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.096272    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.096366    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.096443    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.096450    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:26.097190    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:26.097243    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.118880    2563 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2596 into the system container \"/system.slice\": <nil>"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.197078    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.197919    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.197945    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.197954    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.197981    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-99.ec2.internal"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.205957    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-99.ec2.internal"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:26.205987    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-99.ec2.internal\": node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:26.221533    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.228557    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.229837    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 16:18:26.351416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.229871    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.229888    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:26.229922    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.232037    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:26.322569    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.330726    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal"]
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.330811    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.331781    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.331809    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.331825    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.334228    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.334357    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.334383    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.335513    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.335525    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.335549    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.335559    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.335529    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.335608    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.337813    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.337834    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.338495    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.338511    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 16:18:26.352731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.338525    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeHasSufficientPID"
Jul 07 16:18:26.386323 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.386304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/513423b009a49dcd04d202974a0d6760-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"513423b009a49dcd04d202974a0d6760\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:26.386426 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.386330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e71a3a3460c87775c4ea31484e344c7e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-99.ec2.internal\" (UID: \"e71a3a3460c87775c4ea31484e344c7e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:26.386426 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:26.386348    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/513423b009a49dcd04d202974a0d6760-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"513423b009a49dcd04d202974a0d6760\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:26.388544 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:26.388414    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-99.ec2.internal\" not found" node="ip-10-0-136-99.ec2.internal"
Jul 07 16:18:27.550154 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:27.550138    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-99.ec2.internal\" not found" node="ip-10-0-136-99.ec2.internal"
Jul 07 16:18:27.573635 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:27.573612    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:27.637174 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.637144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/513423b009a49dcd04d202974a0d6760-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"513423b009a49dcd04d202974a0d6760\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:27.637174 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.637174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e71a3a3460c87775c4ea31484e344c7e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-99.ec2.internal\" (UID: \"e71a3a3460c87775c4ea31484e344c7e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:27.637353 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.637190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/513423b009a49dcd04d202974a0d6760-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"513423b009a49dcd04d202974a0d6760\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:27.637353 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.637217    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/513423b009a49dcd04d202974a0d6760-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"513423b009a49dcd04d202974a0d6760\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:27.637353 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.637244    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/513423b009a49dcd04d202974a0d6760-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal\" (UID: \"513423b009a49dcd04d202974a0d6760\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:27.637353 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.637246    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e71a3a3460c87775c4ea31484e344c7e-config\") pod \"kube-apiserver-proxy-ip-10-0-136-99.ec2.internal\" (UID: \"e71a3a3460c87775c4ea31484e344c7e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:27.674299 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:27.674251    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:27.774787 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:27.774754    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:27.843246 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.843204    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:27.853357 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.853342    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:27.875482 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:27.875461    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:27.976059 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:27.975964    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:27.997118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.997099    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 16:18:27.997310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.997289    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 16:18:27.997357 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:27.997291    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 16:18:28.069958 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.069908    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:13:27 +0000 UTC" deadline="2028-02-18 14:10:19.534431945 +0000 UTC"
Jul 07 16:18:28.069958 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.069946    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14181h51m51.464489553s"
Jul 07 16:18:28.076437 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:28.076419    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-99.ec2.internal\" not found"
Jul 07 16:18:28.123174 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.123149    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:28.133601 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.133582    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 16:18:28.133601 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.133589    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:28.145072 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.145054    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 16:18:28.146635 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.146621    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal"
Jul 07 16:18:28.148593 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.148179    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 16:18:28.153751 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.153737    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 16:18:28.170492 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.170470    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4v5vj"
Jul 07 16:18:28.178873 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.178857    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4v5vj"
Jul 07 16:18:28.198821 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.198802    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:28.421382 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:28.421351    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode71a3a3460c87775c4ea31484e344c7e.slice/crio-08c12be6d94b8ea7ca8df9a2c38668b510a0955bd08c0184e18f9dc86a725b0d WatchSource:0}: Error finding container 08c12be6d94b8ea7ca8df9a2c38668b510a0955bd08c0184e18f9dc86a725b0d: Status 404 returned error can't find the container with id 08c12be6d94b8ea7ca8df9a2c38668b510a0955bd08c0184e18f9dc86a725b0d
Jul 07 16:18:28.426858 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.426809    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:18:28.432431 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:28.432412    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513423b009a49dcd04d202974a0d6760.slice/crio-b3dc6210fe51d615b22e56100a7c215791b38066a97ecc98972d9f7c6cf5a645 WatchSource:0}: Error finding container b3dc6210fe51d615b22e56100a7c215791b38066a97ecc98972d9f7c6cf5a645: Status 404 returned error can't find the container with id b3dc6210fe51d615b22e56100a7c215791b38066a97ecc98972d9f7c6cf5a645
Jul 07 16:18:28.882020 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:28.881993    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:29.044745 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.044703    2563 apiserver.go:52] "Watching apiserver"
Jul 07 16:18:29.054465 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.054262    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 16:18:29.055461 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.055415    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-m7q6n","openshift-ovn-kubernetes/ovnkube-node-r2xjd","kube-system/global-pull-secret-syncer-t8nzc","kube-system/konnectivity-agent-6djm2","kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal","openshift-dns/node-resolver-xqh4g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal","openshift-multus/multus-zt4dm","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98","openshift-cluster-node-tuning-operator/tuned-szctq","openshift-image-registry/node-ca-l4g2p","openshift-multus/multus-additional-cni-plugins-n8q64","openshift-multus/network-metrics-daemon-kgchl","openshift-network-diagnostics/network-check-target-z56bk"]
Jul 07 16:18:29.058145 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.058044    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.060485 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.060112    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.061383 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.061362    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-r2xvc\""
Jul 07 16:18:29.061616 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.061600    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 16:18:29.061829 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.061813    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:18:29.062482 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.062461    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:29.062571 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.062533    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 16:18:29.062571 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.062535    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:29.062725 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.062468    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 16:18:29.062951 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.062932    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bt5c7\""
Jul 07 16:18:29.063052 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.063037    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 16:18:29.064953 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.064551    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:29.066931 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.066913    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:29.067028 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.067007    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:29.067217 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.067200    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 16:18:29.067350 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.067204    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 16:18:29.067435 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.067417    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zc949\""
Jul 07 16:18:29.069973 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.069553    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.071374 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.071350    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.071882 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.071852    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 16:18:29.072209 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.072192    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 16:18:29.072484 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.072396    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w5dpt\""
Jul 07 16:18:29.073897 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.073865    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 16:18:29.075161 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.075134    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 16:18:29.075526 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.075252    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 16:18:29.075680 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.075662    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:29.075753 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.075694    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g5h8q\""
Jul 07 16:18:29.075753 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.075740    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:29.077990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.077312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.080854 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.080733    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 16:18:29.080958 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.080942    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 16:18:29.082473 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.082454    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 16:18:29.082724 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.082475    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 16:18:29.083955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.082983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.083955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.082529    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.083955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.083484    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 16:18:29.083955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.083778    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 16:18:29.083955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.083928    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x7mpw\""
Jul 07 16:18:29.084908 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.084890    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.085408 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.085389    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 16:18:29.085588 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.085569    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:18:29.085848 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.085818    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zsrvb\""
Jul 07 16:18:29.086199 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.086178    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 16:18:29.087010 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.086992    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 16:18:29.087201 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.087186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 16:18:29.087453 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.087435    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 16:18:29.087524 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.087510    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 16:18:29.087649 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.087632    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 16:18:29.088818 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.087689    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r76vg\""
Jul 07 16:18:29.088925 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.087730    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-87226\""
Jul 07 16:18:29.088925 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.087760    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 16:18:29.134970 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.134908    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 16:18:29.145143 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-kubelet\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.145143 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-var-lib-cni-bin\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.145298 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-var-lib-kubelet\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.145298 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-modprobe-d\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.145403 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8plm4\" (UniqueName: \"kubernetes.io/projected/e598bd7d-c404-45fd-a7d2-f7deb99c4970-kube-api-access-8plm4\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.145403 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-systemd-units\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.145403 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-run-ovn\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.145403 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-conf-dir\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.145589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-sysctl-conf\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.145589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-systemd\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.145589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef779192-a1a5-446e-9eb3-472d5871d0fb-serviceca\") pod \"node-ca-l4g2p\" (UID: \"ef779192-a1a5-446e-9eb3-472d5871d0fb\") " pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.145589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52jtz\" (UniqueName: \"kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz\") pod \"network-check-target-z56bk\" (UID: \"a32c936b-17f3-4ceb-abdd-255c91ee33ef\") " pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:29.145589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2485ebb9-a662-47cc-95b3-7ee9191755f4-ovnkube-script-lib\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.145589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-cni-dir\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.145589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-os-release\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.145589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6g6k\" (UniqueName: \"kubernetes.io/projected/58b50554-805f-494c-9743-e0c710481d85-kube-api-access-t6g6k\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.145589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145589    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da99183f-c36a-45b4-aafd-893a7fb07e1c-konnectivity-ca\") pod \"konnectivity-agent-6djm2\" (UID: \"da99183f-c36a-45b4-aafd-893a7fb07e1c\") " pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-sysctl-d\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef779192-a1a5-446e-9eb3-472d5871d0fb-host\") pod \"node-ca-l4g2p\" (UID: \"ef779192-a1a5-446e-9eb3-472d5871d0fb\") " pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e598bd7d-c404-45fd-a7d2-f7deb99c4970-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2485ebb9-a662-47cc-95b3-7ee9191755f4-ovn-node-metrics-cert\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145749    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-etc-selinux\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-etc-openvswitch\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-cni-bin\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-sys-fs\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da99183f-c36a-45b4-aafd-893a7fb07e1c-agent-certs\") pod \"konnectivity-agent-6djm2\" (UID: \"da99183f-c36a-45b4-aafd-893a7fb07e1c\") " pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-run-netns\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.145979    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-run-openvswitch\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.146017 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146005    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-cni-netd\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-run-multus-certs\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-kubernetes\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8jhh\" (UniqueName: \"kubernetes.io/projected/96fd75aa-b918-4566-a7e9-61e2d05a4082-kube-api-access-l8jhh\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs9hv\" (UniqueName: \"kubernetes.io/projected/d6abe5ea-e22a-4433-ad26-2eb34a71290d-kube-api-access-fs9hv\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e12111d-b924-495e-b09b-7c40400657d8-dbus\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-node-log\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146241    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4mcz\" (UniqueName: \"kubernetes.io/projected/2485ebb9-a662-47cc-95b3-7ee9191755f4-kube-api-access-c4mcz\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146273    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-run-k8s-cni-cncf-io\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-daemon-config\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-run\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146336    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-sys\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146368    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96fd75aa-b918-4566-a7e9-61e2d05a4082-tmp\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f599t\" (UniqueName: \"kubernetes.io/projected/ef779192-a1a5-446e-9eb3-472d5871d0fb-kube-api-access-f599t\") pod \"node-ca-l4g2p\" (UID: \"ef779192-a1a5-446e-9eb3-472d5871d0fb\") " pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.146807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-slash\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146497    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1be8f24-6a51-4821-89fe-72b48e43867c-cni-binary-copy\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e12111d-b924-495e-b09b-7c40400657d8-kubelet-config\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b356c87-bfb6-4dbd-80c9-69d09c1899f2-iptables-alerter-script\") pod \"iptables-alerter-m7q6n\" (UID: \"4b356c87-bfb6-4dbd-80c9-69d09c1899f2\") " pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-cnibin\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146601    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-socket-dir-parent\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-run-netns\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-os-release\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-log-socket\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-hostroot\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-registration-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-device-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-var-lib-openvswitch\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2485ebb9-a662-47cc-95b3-7ee9191755f4-ovnkube-config\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-etc-kubernetes\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv9mx\" (UniqueName: \"kubernetes.io/projected/b1be8f24-6a51-4821-89fe-72b48e43867c-kube-api-access-tv9mx\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.147639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-cnibin\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146947    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e598bd7d-c404-45fd-a7d2-f7deb99c4970-cni-binary-copy\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.146991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48e6664e-d120-47c3-bd5b-c51e68bc47cb-hosts-file\") pod \"node-resolver-xqh4g\" (UID: \"48e6664e-d120-47c3-bd5b-c51e68bc47cb\") " pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48e6664e-d120-47c3-bd5b-c51e68bc47cb-tmp-dir\") pod \"node-resolver-xqh4g\" (UID: \"48e6664e-d120-47c3-bd5b-c51e68bc47cb\") " pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwdpc\" (UniqueName: \"kubernetes.io/projected/48e6664e-d120-47c3-bd5b-c51e68bc47cb-kube-api-access-gwdpc\") pod \"node-resolver-xqh4g\" (UID: \"48e6664e-d120-47c3-bd5b-c51e68bc47cb\") " pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-run-systemd\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b356c87-bfb6-4dbd-80c9-69d09c1899f2-host-slash\") pod \"iptables-alerter-m7q6n\" (UID: \"4b356c87-bfb6-4dbd-80c9-69d09c1899f2\") " pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvfsz\" (UniqueName: \"kubernetes.io/projected/4b356c87-bfb6-4dbd-80c9-69d09c1899f2-kube-api-access-dvfsz\") pod \"iptables-alerter-m7q6n\" (UID: \"4b356c87-bfb6-4dbd-80c9-69d09c1899f2\") " pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147180    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-sysconfig\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-lib-modules\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147284    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2485ebb9-a662-47cc-95b3-7ee9191755f4-env-overrides\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-system-cni-dir\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-var-lib-kubelet\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-host\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.148454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147413    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-tuned\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.149210 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-socket-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.149210 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e598bd7d-c404-45fd-a7d2-f7deb99c4970-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.149210 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-var-lib-cni-multus\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.149210 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.147510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-system-cni-dir\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.182387 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.182352    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:13:28 +0000 UTC" deadline="2028-03-18 16:53:48.999144564 +0000 UTC"
Jul 07 16:18:29.182387 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.182385    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14880h35m19.816763461s"
Jul 07 16:18:29.248696 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-var-lib-openvswitch\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.248696 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2485ebb9-a662-47cc-95b3-7ee9191755f4-ovnkube-config\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-etc-kubernetes\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv9mx\" (UniqueName: \"kubernetes.io/projected/b1be8f24-6a51-4821-89fe-72b48e43867c-kube-api-access-tv9mx\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-cnibin\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e598bd7d-c404-45fd-a7d2-f7deb99c4970-cni-binary-copy\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248791    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-var-lib-openvswitch\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48e6664e-d120-47c3-bd5b-c51e68bc47cb-hosts-file\") pod \"node-resolver-xqh4g\" (UID: \"48e6664e-d120-47c3-bd5b-c51e68bc47cb\") " pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48e6664e-d120-47c3-bd5b-c51e68bc47cb-tmp-dir\") pod \"node-resolver-xqh4g\" (UID: \"48e6664e-d120-47c3-bd5b-c51e68bc47cb\") " pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwdpc\" (UniqueName: \"kubernetes.io/projected/48e6664e-d120-47c3-bd5b-c51e68bc47cb-kube-api-access-gwdpc\") pod \"node-resolver-xqh4g\" (UID: \"48e6664e-d120-47c3-bd5b-c51e68bc47cb\") " pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248866    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-cnibin\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248873    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-run-systemd\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b356c87-bfb6-4dbd-80c9-69d09c1899f2-host-slash\") pod \"iptables-alerter-m7q6n\" (UID: \"4b356c87-bfb6-4dbd-80c9-69d09c1899f2\") " pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248923    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48e6664e-d120-47c3-bd5b-c51e68bc47cb-hosts-file\") pod \"node-resolver-xqh4g\" (UID: \"48e6664e-d120-47c3-bd5b-c51e68bc47cb\") " pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvfsz\" (UniqueName: \"kubernetes.io/projected/4b356c87-bfb6-4dbd-80c9-69d09c1899f2-kube-api-access-dvfsz\") pod \"iptables-alerter-m7q6n\" (UID: \"4b356c87-bfb6-4dbd-80c9-69d09c1899f2\") " pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-sysconfig\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.248984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-lib-modules\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.248991    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:29.250071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2485ebb9-a662-47cc-95b3-7ee9191755f4-env-overrides\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-system-cni-dir\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-var-lib-kubelet\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-host\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.249158    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret podName:8e12111d-b924-495e-b09b-7c40400657d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:29.749124025 +0000 UTC m=+3.103409270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret") pod "global-pull-secret-syncer-t8nzc" (UID: "8e12111d-b924-495e-b09b-7c40400657d8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249161    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-host\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249189    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-tuned\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249201    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-etc-kubernetes\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249213    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48e6664e-d120-47c3-bd5b-c51e68bc47cb-tmp-dir\") pod \"node-resolver-xqh4g\" (UID: \"48e6664e-d120-47c3-bd5b-c51e68bc47cb\") " pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249245    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b356c87-bfb6-4dbd-80c9-69d09c1899f2-host-slash\") pod \"iptables-alerter-m7q6n\" (UID: \"4b356c87-bfb6-4dbd-80c9-69d09c1899f2\") " pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.249297    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-socket-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e598bd7d-c404-45fd-a7d2-f7deb99c4970-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.249381    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs podName:d6abe5ea-e22a-4433-ad26-2eb34a71290d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:29.749361258 +0000 UTC m=+3.103646498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs") pod "network-metrics-daemon-kgchl" (UID: "d6abe5ea-e22a-4433-ad26-2eb34a71290d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-var-lib-cni-multus\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.250990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249413    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2485ebb9-a662-47cc-95b3-7ee9191755f4-ovnkube-config\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-system-cni-dir\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249438    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-run-systemd\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-kubelet\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-var-lib-cni-bin\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-var-lib-kubelet\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249521    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-system-cni-dir\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-modprobe-d\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249569    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-system-cni-dir\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8plm4\" (UniqueName: \"kubernetes.io/projected/e598bd7d-c404-45fd-a7d2-f7deb99c4970-kube-api-access-8plm4\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-systemd-units\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-run-ovn\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249631    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2485ebb9-a662-47cc-95b3-7ee9191755f4-env-overrides\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-conf-dir\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249670    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-conf-dir\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-sysctl-conf\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249726    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-run-ovn\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249754    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-kubelet\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.251743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249765    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-socket-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249811    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-var-lib-cni-bin\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249813    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-lib-modules\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249829    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-sysctl-conf\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-systemd\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249862    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-var-lib-kubelet\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249888    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-modprobe-d\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249896    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-systemd-units\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249906    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-systemd\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249874    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-var-lib-kubelet\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249916    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-var-lib-cni-multus\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef779192-a1a5-446e-9eb3-472d5871d0fb-serviceca\") pod \"node-ca-l4g2p\" (UID: \"ef779192-a1a5-446e-9eb3-472d5871d0fb\") " pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249904    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e598bd7d-c404-45fd-a7d2-f7deb99c4970-cni-binary-copy\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249944    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-sysconfig\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jtz\" (UniqueName: \"kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz\") pod \"network-check-target-z56bk\" (UID: \"a32c936b-17f3-4ceb-abdd-255c91ee33ef\") " pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.249971    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2485ebb9-a662-47cc-95b3-7ee9191755f4-ovnkube-script-lib\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-cni-dir\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-os-release\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.252576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6g6k\" (UniqueName: \"kubernetes.io/projected/58b50554-805f-494c-9743-e0c710481d85-kube-api-access-t6g6k\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da99183f-c36a-45b4-aafd-893a7fb07e1c-konnectivity-ca\") pod \"konnectivity-agent-6djm2\" (UID: \"da99183f-c36a-45b4-aafd-893a7fb07e1c\") " pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-sysctl-d\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef779192-a1a5-446e-9eb3-472d5871d0fb-host\") pod \"node-ca-l4g2p\" (UID: \"ef779192-a1a5-446e-9eb3-472d5871d0fb\") " pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e598bd7d-c404-45fd-a7d2-f7deb99c4970-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2485ebb9-a662-47cc-95b3-7ee9191755f4-ovn-node-metrics-cert\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-etc-selinux\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-etc-openvswitch\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250331    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e598bd7d-c404-45fd-a7d2-f7deb99c4970-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-cni-bin\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250392    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250419    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ef779192-a1a5-446e-9eb3-472d5871d0fb-serviceca\") pod \"node-ca-l4g2p\" (UID: \"ef779192-a1a5-446e-9eb3-472d5871d0fb\") " pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-sys-fs\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da99183f-c36a-45b4-aafd-893a7fb07e1c-agent-certs\") pod \"konnectivity-agent-6djm2\" (UID: \"da99183f-c36a-45b4-aafd-893a7fb07e1c\") " pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250474    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-sys-fs\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.253096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250482    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2485ebb9-a662-47cc-95b3-7ee9191755f4-ovnkube-script-lib\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250492    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-run-netns\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250516    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-run-openvswitch\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-cni-netd\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-run-multus-certs\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250578    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-kubernetes\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250636    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8jhh\" (UniqueName: \"kubernetes.io/projected/96fd75aa-b918-4566-a7e9-61e2d05a4082-kube-api-access-l8jhh\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs9hv\" (UniqueName: \"kubernetes.io/projected/d6abe5ea-e22a-4433-ad26-2eb34a71290d-kube-api-access-fs9hv\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250679    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e12111d-b924-495e-b09b-7c40400657d8-dbus\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250747    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-node-log\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4mcz\" (UniqueName: \"kubernetes.io/projected/2485ebb9-a662-47cc-95b3-7ee9191755f4-kube-api-access-c4mcz\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-run-k8s-cni-cncf-io\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-daemon-config\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-run\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-sys\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.253553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96fd75aa-b918-4566-a7e9-61e2d05a4082-tmp\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250903    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da99183f-c36a-45b4-aafd-893a7fb07e1c-konnectivity-ca\") pod \"konnectivity-agent-6djm2\" (UID: \"da99183f-c36a-45b4-aafd-893a7fb07e1c\") " pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250926    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f599t\" (UniqueName: \"kubernetes.io/projected/ef779192-a1a5-446e-9eb3-472d5871d0fb-kube-api-access-f599t\") pod \"node-ca-l4g2p\" (UID: \"ef779192-a1a5-446e-9eb3-472d5871d0fb\") " pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-slash\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250987    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ef779192-a1a5-446e-9eb3-472d5871d0fb-host\") pod \"node-ca-l4g2p\" (UID: \"ef779192-a1a5-446e-9eb3-472d5871d0fb\") " pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.250998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1be8f24-6a51-4821-89fe-72b48e43867c-cni-binary-copy\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e12111d-b924-495e-b09b-7c40400657d8-kubelet-config\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251029    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-run-netns\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b356c87-bfb6-4dbd-80c9-69d09c1899f2-iptables-alerter-script\") pod \"iptables-alerter-m7q6n\" (UID: \"4b356c87-bfb6-4dbd-80c9-69d09c1899f2\") " pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251047    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-sysctl-d\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251061    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-run-openvswitch\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-cnibin\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251098    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-run-multus-certs\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-socket-dir-parent\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-run-netns\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251173    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-os-release\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251193    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-log-socket\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-hostroot\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-registration-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-device-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251309    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-cni-netd\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251335    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-device-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251365    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-cnibin\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251382    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-kubernetes\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251424    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-run\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251445    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e598bd7d-c404-45fd-a7d2-f7deb99c4970-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251461    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96fd75aa-b918-4566-a7e9-61e2d05a4082-sys\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251500    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-slash\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251771    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-os-release\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251828    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-socket-dir-parent\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251892    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-run-netns\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251901    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b1be8f24-6a51-4821-89fe-72b48e43867c-cni-binary-copy\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251904    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-daemon-config\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251954    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251956    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8e12111d-b924-495e-b09b-7c40400657d8-kubelet-config\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.251974    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.254600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252070    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-hostroot\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252076    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-multus-cni-dir\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252108    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-log-socket\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252148    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-node-log\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252109    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8e12111d-b924-495e-b09b-7c40400657d8-dbus\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252192    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-etc-openvswitch\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252237    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e598bd7d-c404-45fd-a7d2-f7deb99c4970-tuning-conf-dir\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252266    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-etc-selinux\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252326    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-host-run-k8s-cni-cncf-io\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252344    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b1be8f24-6a51-4821-89fe-72b48e43867c-os-release\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252375    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2485ebb9-a662-47cc-95b3-7ee9191755f4-host-cni-bin\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252406    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/58b50554-805f-494c-9743-e0c710481d85-registration-dir\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.252436    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b356c87-bfb6-4dbd-80c9-69d09c1899f2-iptables-alerter-script\") pod \"iptables-alerter-m7q6n\" (UID: \"4b356c87-bfb6-4dbd-80c9-69d09c1899f2\") " pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.254084    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/96fd75aa-b918-4566-a7e9-61e2d05a4082-tmp\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.254111    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/96fd75aa-b918-4566-a7e9-61e2d05a4082-etc-tuned\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.254216    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2485ebb9-a662-47cc-95b3-7ee9191755f4-ovn-node-metrics-cert\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.255102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.254234    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da99183f-c36a-45b4-aafd-893a7fb07e1c-agent-certs\") pod \"konnectivity-agent-6djm2\" (UID: \"da99183f-c36a-45b4-aafd-893a7fb07e1c\") " pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:29.261081 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.261060    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwdpc\" (UniqueName: \"kubernetes.io/projected/48e6664e-d120-47c3-bd5b-c51e68bc47cb-kube-api-access-gwdpc\") pod \"node-resolver-xqh4g\" (UID: \"48e6664e-d120-47c3-bd5b-c51e68bc47cb\") " pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.262619 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.262597    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:29.262619 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.262623    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:29.262903 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.262635    2563 projected.go:196] Error preparing data for projected volume kube-api-access-52jtz for pod openshift-network-diagnostics/network-check-target-z56bk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:29.262903 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.262696    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz podName:a32c936b-17f3-4ceb-abdd-255c91ee33ef nodeName:}" failed. No retries permitted until 2026-07-07 16:18:29.762679752 +0000 UTC m=+3.116965000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-52jtz" (UniqueName: "kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz") pod "network-check-target-z56bk" (UID: "a32c936b-17f3-4ceb-abdd-255c91ee33ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:29.263029 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.262970    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f599t\" (UniqueName: \"kubernetes.io/projected/ef779192-a1a5-446e-9eb3-472d5871d0fb-kube-api-access-f599t\") pod \"node-ca-l4g2p\" (UID: \"ef779192-a1a5-446e-9eb3-472d5871d0fb\") " pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.263194 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.263173    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv9mx\" (UniqueName: \"kubernetes.io/projected/b1be8f24-6a51-4821-89fe-72b48e43867c-kube-api-access-tv9mx\") pod \"multus-zt4dm\" (UID: \"b1be8f24-6a51-4821-89fe-72b48e43867c\") " pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.265041 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.265015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8jhh\" (UniqueName: \"kubernetes.io/projected/96fd75aa-b918-4566-a7e9-61e2d05a4082-kube-api-access-l8jhh\") pod \"tuned-szctq\" (UID: \"96fd75aa-b918-4566-a7e9-61e2d05a4082\") " pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.265471 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.265447    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs9hv\" (UniqueName: \"kubernetes.io/projected/d6abe5ea-e22a-4433-ad26-2eb34a71290d-kube-api-access-fs9hv\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:29.265556 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.265515    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4mcz\" (UniqueName: \"kubernetes.io/projected/2485ebb9-a662-47cc-95b3-7ee9191755f4-kube-api-access-c4mcz\") pod \"ovnkube-node-r2xjd\" (UID: \"2485ebb9-a662-47cc-95b3-7ee9191755f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.265831 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.265800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvfsz\" (UniqueName: \"kubernetes.io/projected/4b356c87-bfb6-4dbd-80c9-69d09c1899f2-kube-api-access-dvfsz\") pod \"iptables-alerter-m7q6n\" (UID: \"4b356c87-bfb6-4dbd-80c9-69d09c1899f2\") " pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.266142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.266123    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6g6k\" (UniqueName: \"kubernetes.io/projected/58b50554-805f-494c-9743-e0c710481d85-kube-api-access-t6g6k\") pod \"aws-ebs-csi-driver-node-qsz98\" (UID: \"58b50554-805f-494c-9743-e0c710481d85\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.266234 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.266217    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8plm4\" (UniqueName: \"kubernetes.io/projected/e598bd7d-c404-45fd-a7d2-f7deb99c4970-kube-api-access-8plm4\") pod \"multus-additional-cni-plugins-n8q64\" (UID: \"e598bd7d-c404-45fd-a7d2-f7deb99c4970\") " pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.330705 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.330665    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 16:18:29.375256 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.375233    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szctq"
Jul 07 16:18:29.384468 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.384380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" event={"ID":"513423b009a49dcd04d202974a0d6760","Type":"ContainerStarted","Data":"b3dc6210fe51d615b22e56100a7c215791b38066a97ecc98972d9f7c6cf5a645"}
Jul 07 16:18:29.385402 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.385381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" event={"ID":"e71a3a3460c87775c4ea31484e344c7e","Type":"ContainerStarted","Data":"08c12be6d94b8ea7ca8df9a2c38668b510a0955bd08c0184e18f9dc86a725b0d"}
Jul 07 16:18:29.387576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.387558    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:29.398282 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.398125    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l4g2p"
Jul 07 16:18:29.404685 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.404667    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xqh4g"
Jul 07 16:18:29.413373 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.413351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98"
Jul 07 16:18:29.420979 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.420961    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:29.430504 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.430486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zt4dm"
Jul 07 16:18:29.439182 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.439163    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-m7q6n"
Jul 07 16:18:29.444774 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.444754    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-n8q64"
Jul 07 16:18:29.754076 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.754007    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:29.754076 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.754045    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:29.754277 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.754151    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:29.754277 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.754200    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:29.754277 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.754236    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret podName:8e12111d-b924-495e-b09b-7c40400657d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:30.754209829 +0000 UTC m=+4.108495078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret") pod "global-pull-secret-syncer-t8nzc" (UID: "8e12111d-b924-495e-b09b-7c40400657d8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:29.754277 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.754275    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs podName:d6abe5ea-e22a-4433-ad26-2eb34a71290d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:30.75424585 +0000 UTC m=+4.108531086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs") pod "network-metrics-daemon-kgchl" (UID: "d6abe5ea-e22a-4433-ad26-2eb34a71290d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:29.855195 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:29.855157    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jtz\" (UniqueName: \"kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz\") pod \"network-check-target-z56bk\" (UID: \"a32c936b-17f3-4ceb-abdd-255c91ee33ef\") " pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:29.855370 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.855336    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:29.855370 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.855359    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:29.855370 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.855371    2563 projected.go:196] Error preparing data for projected volume kube-api-access-52jtz for pod openshift-network-diagnostics/network-check-target-z56bk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:29.855533 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:29.855430    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz podName:a32c936b-17f3-4ceb-abdd-255c91ee33ef nodeName:}" failed. No retries permitted until 2026-07-07 16:18:30.855413599 +0000 UTC m=+4.209698828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-52jtz" (UniqueName: "kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz") pod "network-check-target-z56bk" (UID: "a32c936b-17f3-4ceb-abdd-255c91ee33ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:30.183516 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:30.183457    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:13:28 +0000 UTC" deadline="2027-12-29 21:16:07.637127155 +0000 UTC"
Jul 07 16:18:30.183516 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:30.183507    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12964h57m37.453622374s"
Jul 07 16:18:30.374540 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:30.374391    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2485ebb9_a662_47cc_95b3_7ee9191755f4.slice/crio-09adf8606bb8c4ab8c4a61842efba0fca6ac553787b81ea16e3723bf0300b069 WatchSource:0}: Error finding container 09adf8606bb8c4ab8c4a61842efba0fca6ac553787b81ea16e3723bf0300b069: Status 404 returned error can't find the container with id 09adf8606bb8c4ab8c4a61842efba0fca6ac553787b81ea16e3723bf0300b069
Jul 07 16:18:30.376174 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:30.376150    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48e6664e_d120_47c3_bd5b_c51e68bc47cb.slice/crio-8831c310cc936395beaf5b7c9b636c25b04f09f40b7498497354ffb4273524fe WatchSource:0}: Error finding container 8831c310cc936395beaf5b7c9b636c25b04f09f40b7498497354ffb4273524fe: Status 404 returned error can't find the container with id 8831c310cc936395beaf5b7c9b636c25b04f09f40b7498497354ffb4273524fe
Jul 07 16:18:30.380956 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:30.380937    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:30.381068 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:30.381047    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:30.381128 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:30.381087    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:30.381188 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:30.381160    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:30.387412 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:30.387392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xqh4g" event={"ID":"48e6664e-d120-47c3-bd5b-c51e68bc47cb","Type":"ContainerStarted","Data":"8831c310cc936395beaf5b7c9b636c25b04f09f40b7498497354ffb4273524fe"}
Jul 07 16:18:30.388328 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:30.388309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd" event={"ID":"2485ebb9-a662-47cc-95b3-7ee9191755f4","Type":"ContainerStarted","Data":"09adf8606bb8c4ab8c4a61842efba0fca6ac553787b81ea16e3723bf0300b069"}
Jul 07 16:18:30.398193 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:30.398176    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96fd75aa_b918_4566_a7e9_61e2d05a4082.slice/crio-5033d23a3c4fd1cad93cbf38157a57b595c591a0bfb90dfec65bb7a6be443774 WatchSource:0}: Error finding container 5033d23a3c4fd1cad93cbf38157a57b595c591a0bfb90dfec65bb7a6be443774: Status 404 returned error can't find the container with id 5033d23a3c4fd1cad93cbf38157a57b595c591a0bfb90dfec65bb7a6be443774
Jul 07 16:18:30.399330 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:30.399307    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode598bd7d_c404_45fd_a7d2_f7deb99c4970.slice/crio-b9a4b875f9e30119d0262f8147e1cbf89eebb3167f34bf91abe51d1bfb82fb75 WatchSource:0}: Error finding container b9a4b875f9e30119d0262f8147e1cbf89eebb3167f34bf91abe51d1bfb82fb75: Status 404 returned error can't find the container with id b9a4b875f9e30119d0262f8147e1cbf89eebb3167f34bf91abe51d1bfb82fb75
Jul 07 16:18:30.400177 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:30.400156    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda99183f_c36a_45b4_aafd_893a7fb07e1c.slice/crio-6751c8ecb28586c4e8f38174c50a78907cb3795ca9018356747e97744b794a70 WatchSource:0}: Error finding container 6751c8ecb28586c4e8f38174c50a78907cb3795ca9018356747e97744b794a70: Status 404 returned error can't find the container with id 6751c8ecb28586c4e8f38174c50a78907cb3795ca9018356747e97744b794a70
Jul 07 16:18:30.400678 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:30.400638    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef779192_a1a5_446e_9eb3_472d5871d0fb.slice/crio-fdf6a4d7b7f5ac54d43eb7f9aa9fc054e0cf653ae293c2b1fb06115419a77ec0 WatchSource:0}: Error finding container fdf6a4d7b7f5ac54d43eb7f9aa9fc054e0cf653ae293c2b1fb06115419a77ec0: Status 404 returned error can't find the container with id fdf6a4d7b7f5ac54d43eb7f9aa9fc054e0cf653ae293c2b1fb06115419a77ec0
Jul 07 16:18:30.401892 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:30.401871    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1be8f24_6a51_4821_89fe_72b48e43867c.slice/crio-d4add474c2be7ad3c287f4ce8551f3f0a74c344fea42e955f02cee8f10be867c WatchSource:0}: Error finding container d4add474c2be7ad3c287f4ce8551f3f0a74c344fea42e955f02cee8f10be867c: Status 404 returned error can't find the container with id d4add474c2be7ad3c287f4ce8551f3f0a74c344fea42e955f02cee8f10be867c
Jul 07 16:18:30.403243 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:30.402784    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b50554_805f_494c_9743_e0c710481d85.slice/crio-ff02482154ec4d7d46d92a994265069dfd4ee58d61b2a2f20cd8b6fcaf549bd6 WatchSource:0}: Error finding container ff02482154ec4d7d46d92a994265069dfd4ee58d61b2a2f20cd8b6fcaf549bd6: Status 404 returned error can't find the container with id ff02482154ec4d7d46d92a994265069dfd4ee58d61b2a2f20cd8b6fcaf549bd6
Jul 07 16:18:30.403771 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:18:30.403752    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b356c87_bfb6_4dbd_80c9_69d09c1899f2.slice/crio-94695a6af00208d33bcb5c0f00f757f4a29662d96408a864230f2100a86c1285 WatchSource:0}: Error finding container 94695a6af00208d33bcb5c0f00f757f4a29662d96408a864230f2100a86c1285: Status 404 returned error can't find the container with id 94695a6af00208d33bcb5c0f00f757f4a29662d96408a864230f2100a86c1285
Jul 07 16:18:30.761375 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:30.761257    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:30.761375 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:30.761297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:30.761618 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:30.761414    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:30.761618 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:30.761478    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret podName:8e12111d-b924-495e-b09b-7c40400657d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:32.761463052 +0000 UTC m=+6.115748282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret") pod "global-pull-secret-syncer-t8nzc" (UID: "8e12111d-b924-495e-b09b-7c40400657d8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:30.761618 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:30.761420    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:30.761618 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:30.761553    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs podName:d6abe5ea-e22a-4433-ad26-2eb34a71290d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:32.761541808 +0000 UTC m=+6.115827033 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs") pod "network-metrics-daemon-kgchl" (UID: "d6abe5ea-e22a-4433-ad26-2eb34a71290d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:30.863072 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:30.863033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jtz\" (UniqueName: \"kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz\") pod \"network-check-target-z56bk\" (UID: \"a32c936b-17f3-4ceb-abdd-255c91ee33ef\") " pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:30.863225 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:30.863200    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:30.863225 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:30.863222    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:30.863337 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:30.863235    2563 projected.go:196] Error preparing data for projected volume kube-api-access-52jtz for pod openshift-network-diagnostics/network-check-target-z56bk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:30.863337 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:30.863302    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz podName:a32c936b-17f3-4ceb-abdd-255c91ee33ef nodeName:}" failed. No retries permitted until 2026-07-07 16:18:32.86328171 +0000 UTC m=+6.217566938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-52jtz" (UniqueName: "kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz") pod "network-check-target-z56bk" (UID: "a32c936b-17f3-4ceb-abdd-255c91ee33ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:31.383719 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.383669    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:31.384195 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:31.383812    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:31.414683 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.414324    2563 generic.go:356] "Generic (PLEG): container finished" podID="513423b009a49dcd04d202974a0d6760" containerID="4f62d32ac992371acdfef177e7182cd47046a9ab87eb5f35ed65e83878b90271" exitCode=0
Jul 07 16:18:31.414683 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.414436    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" event={"ID":"513423b009a49dcd04d202974a0d6760","Type":"ContainerDied","Data":"4f62d32ac992371acdfef177e7182cd47046a9ab87eb5f35ed65e83878b90271"}
Jul 07 16:18:31.436637 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.435965    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" event={"ID":"e71a3a3460c87775c4ea31484e344c7e","Type":"ContainerStarted","Data":"8323cc7b8a76409745395ef5abd0fab01ff05216c3a9b4cbac340ff72e55b359"}
Jul 07 16:18:31.455807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.455726    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m7q6n" event={"ID":"4b356c87-bfb6-4dbd-80c9-69d09c1899f2","Type":"ContainerStarted","Data":"94695a6af00208d33bcb5c0f00f757f4a29662d96408a864230f2100a86c1285"}
Jul 07 16:18:31.470904 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.470872    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l4g2p" event={"ID":"ef779192-a1a5-446e-9eb3-472d5871d0fb","Type":"ContainerStarted","Data":"fdf6a4d7b7f5ac54d43eb7f9aa9fc054e0cf653ae293c2b1fb06115419a77ec0"}
Jul 07 16:18:31.480355 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.480270    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szctq" event={"ID":"96fd75aa-b918-4566-a7e9-61e2d05a4082","Type":"ContainerStarted","Data":"5033d23a3c4fd1cad93cbf38157a57b595c591a0bfb90dfec65bb7a6be443774"}
Jul 07 16:18:31.488204 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.488129    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98" event={"ID":"58b50554-805f-494c-9743-e0c710481d85","Type":"ContainerStarted","Data":"ff02482154ec4d7d46d92a994265069dfd4ee58d61b2a2f20cd8b6fcaf549bd6"}
Jul 07 16:18:31.492415 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.492370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zt4dm" event={"ID":"b1be8f24-6a51-4821-89fe-72b48e43867c","Type":"ContainerStarted","Data":"d4add474c2be7ad3c287f4ce8551f3f0a74c344fea42e955f02cee8f10be867c"}
Jul 07 16:18:31.510711 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.510671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6djm2" event={"ID":"da99183f-c36a-45b4-aafd-893a7fb07e1c","Type":"ContainerStarted","Data":"6751c8ecb28586c4e8f38174c50a78907cb3795ca9018356747e97744b794a70"}
Jul 07 16:18:31.524982 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:31.524887    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8q64" event={"ID":"e598bd7d-c404-45fd-a7d2-f7deb99c4970","Type":"ContainerStarted","Data":"b9a4b875f9e30119d0262f8147e1cbf89eebb3167f34bf91abe51d1bfb82fb75"}
Jul 07 16:18:32.381644 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:32.381610    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:32.381830 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:32.381743    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:32.381830 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:32.381817    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:32.382333 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:32.382307    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:32.558537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:32.558390    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" event={"ID":"513423b009a49dcd04d202974a0d6760","Type":"ContainerStarted","Data":"ad4175c7445ff01887c263c7a7725b73fb29a6d308382da7d4abccc258082621"}
Jul 07 16:18:32.581158 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:32.580219    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-99.ec2.internal" podStartSLOduration=4.580198611 podStartE2EDuration="4.580198611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:31.45203844 +0000 UTC m=+4.806323689" watchObservedRunningTime="2026-07-07 16:18:32.580198611 +0000 UTC m=+5.934483861"
Jul 07 16:18:32.781428 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:32.781339    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:32.781617 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:32.781457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:32.781680 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:32.781647    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:32.781736 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:32.781721    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret podName:8e12111d-b924-495e-b09b-7c40400657d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:36.781702848 +0000 UTC m=+10.135988096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret") pod "global-pull-secret-syncer-t8nzc" (UID: "8e12111d-b924-495e-b09b-7c40400657d8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:32.782164 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:32.782142    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:32.782243 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:32.782213    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs podName:d6abe5ea-e22a-4433-ad26-2eb34a71290d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:36.782198913 +0000 UTC m=+10.136484141 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs") pod "network-metrics-daemon-kgchl" (UID: "d6abe5ea-e22a-4433-ad26-2eb34a71290d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:32.882253 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:32.882214    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jtz\" (UniqueName: \"kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz\") pod \"network-check-target-z56bk\" (UID: \"a32c936b-17f3-4ceb-abdd-255c91ee33ef\") " pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:32.882417 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:32.882404    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:32.882475 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:32.882431    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:32.882475 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:32.882444    2563 projected.go:196] Error preparing data for projected volume kube-api-access-52jtz for pod openshift-network-diagnostics/network-check-target-z56bk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:32.882589 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:32.882506    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz podName:a32c936b-17f3-4ceb-abdd-255c91ee33ef nodeName:}" failed. No retries permitted until 2026-07-07 16:18:36.88248683 +0000 UTC m=+10.236772062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-52jtz" (UniqueName: "kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz") pod "network-check-target-z56bk" (UID: "a32c936b-17f3-4ceb-abdd-255c91ee33ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:33.384361 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:33.383872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:33.384361 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:33.384012    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:34.381601 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:34.381565    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:34.382102 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:34.381603    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:34.382102 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:34.381708    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:34.382102 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:34.381880    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:35.383926 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:35.383351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:35.383926 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:35.383500    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:36.381535 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:36.381351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:36.381535 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:36.381386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:36.381782 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:36.381514    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:36.381782 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:36.381527    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:36.815450 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:36.815128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:36.815450 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:36.815177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:36.815450 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:36.815301    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:36.815450 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:36.815339    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:36.815450 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:36.815376    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret podName:8e12111d-b924-495e-b09b-7c40400657d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:18:44.815355346 +0000 UTC m=+18.169640590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret") pod "global-pull-secret-syncer-t8nzc" (UID: "8e12111d-b924-495e-b09b-7c40400657d8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:36.815450 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:36.815406    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs podName:d6abe5ea-e22a-4433-ad26-2eb34a71290d nodeName:}" failed. No retries permitted until 2026-07-07 16:18:44.815387102 +0000 UTC m=+18.169672329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs") pod "network-metrics-daemon-kgchl" (UID: "d6abe5ea-e22a-4433-ad26-2eb34a71290d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:36.916264 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:36.916227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jtz\" (UniqueName: \"kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz\") pod \"network-check-target-z56bk\" (UID: \"a32c936b-17f3-4ceb-abdd-255c91ee33ef\") " pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:36.916474 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:36.916392    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:36.916474 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:36.916414    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:36.916474 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:36.916426    2563 projected.go:196] Error preparing data for projected volume kube-api-access-52jtz for pod openshift-network-diagnostics/network-check-target-z56bk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:36.916661 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:36.916482    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz podName:a32c936b-17f3-4ceb-abdd-255c91ee33ef nodeName:}" failed. No retries permitted until 2026-07-07 16:18:44.916469281 +0000 UTC m=+18.270754507 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-52jtz" (UniqueName: "kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz") pod "network-check-target-z56bk" (UID: "a32c936b-17f3-4ceb-abdd-255c91ee33ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:37.382067 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:37.381931    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:37.382067 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:37.382059    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:38.381389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:38.380911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:38.381389 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:38.381042    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:38.381389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:38.380909    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:38.381389 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:38.381334    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:39.381432 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:39.381405    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:39.381904 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:39.381524    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:40.380964 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:40.380928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:40.381122 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:40.381041    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:40.381122 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:40.381093    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:40.381203 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:40.381184    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:41.381404 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:41.381366    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:41.381783 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:41.381496    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:42.381023 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:42.380986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:42.381201 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:42.380987    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:42.381201 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:42.381119    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:42.381201 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:42.381188    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:43.381684 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:43.381646    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:43.382144 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:43.381791    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:44.380982 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:44.380947    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:44.381186 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:44.381082    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:44.381186 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:44.381118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:44.381268 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:44.381193    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:44.880817 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:44.880780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:44.881265 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:44.880853    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:44.881265 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:44.880972    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:44.881265 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:44.880995    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:44.881265 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:44.881056    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs podName:d6abe5ea-e22a-4433-ad26-2eb34a71290d nodeName:}" failed. No retries permitted until 2026-07-07 16:19:00.881036675 +0000 UTC m=+34.235321905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs") pod "network-metrics-daemon-kgchl" (UID: "d6abe5ea-e22a-4433-ad26-2eb34a71290d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:18:44.881265 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:44.881074    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret podName:8e12111d-b924-495e-b09b-7c40400657d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:00.881065977 +0000 UTC m=+34.235351217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret") pod "global-pull-secret-syncer-t8nzc" (UID: "8e12111d-b924-495e-b09b-7c40400657d8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:18:44.981241 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:44.981206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jtz\" (UniqueName: \"kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz\") pod \"network-check-target-z56bk\" (UID: \"a32c936b-17f3-4ceb-abdd-255c91ee33ef\") " pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:44.981412 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:44.981341    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:18:44.981412 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:44.981354    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:18:44.981412 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:44.981363    2563 projected.go:196] Error preparing data for projected volume kube-api-access-52jtz for pod openshift-network-diagnostics/network-check-target-z56bk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:44.981412 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:44.981413    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz podName:a32c936b-17f3-4ceb-abdd-255c91ee33ef nodeName:}" failed. No retries permitted until 2026-07-07 16:19:00.981397545 +0000 UTC m=+34.335682771 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-52jtz" (UniqueName: "kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz") pod "network-check-target-z56bk" (UID: "a32c936b-17f3-4ceb-abdd-255c91ee33ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:18:45.381418 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:45.381387    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:45.381599 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:45.381519    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:46.381640 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:46.381603    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:46.382057 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:46.381609    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:46.382057 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:46.381731    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:46.382057 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:46.381821    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:47.381587 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:47.381550    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:47.381756 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:47.381671    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:48.380851 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:48.380815    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:48.381033 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:48.380815    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:48.381033 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:48.380961    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:48.381146 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:48.381090    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:49.381810 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.381403    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:49.382396 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:49.381958    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:49.591720 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.591687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98" event={"ID":"58b50554-805f-494c-9743-e0c710481d85","Type":"ContainerStarted","Data":"f58166ca42f44811a019992d332eb9899e013b1fb18d7ac51b34e0fa8ebc1601"}
Jul 07 16:18:49.593024 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.592988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zt4dm" event={"ID":"b1be8f24-6a51-4821-89fe-72b48e43867c","Type":"ContainerStarted","Data":"61af5b9b7735c3e2e6173ea56e7f2d5a9019bfb81c3d48c375b5172107a5f818"}
Jul 07 16:18:49.594355 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.594332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6djm2" event={"ID":"da99183f-c36a-45b4-aafd-893a7fb07e1c","Type":"ContainerStarted","Data":"5f954bbf35107bd3196de7e3ef48456a15cffdd48088399e1a2c5a7f3bfe0aa2"}
Jul 07 16:18:49.595896 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.595874    2563 generic.go:356] "Generic (PLEG): container finished" podID="e598bd7d-c404-45fd-a7d2-f7deb99c4970" containerID="07176592edfada930891ee2770abd6c830bfb95a9d2f4cd91f798f69b9de36b8" exitCode=0
Jul 07 16:18:49.596000 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.595952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8q64" event={"ID":"e598bd7d-c404-45fd-a7d2-f7deb99c4970","Type":"ContainerDied","Data":"07176592edfada930891ee2770abd6c830bfb95a9d2f4cd91f798f69b9de36b8"}
Jul 07 16:18:49.597403 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.597381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xqh4g" event={"ID":"48e6664e-d120-47c3-bd5b-c51e68bc47cb","Type":"ContainerStarted","Data":"37611fe5663444d6ba6a0f33764f980a131fff1669a35cc1965aba9e9353dcc1"}
Jul 07 16:18:49.598872 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.598850    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l4g2p" event={"ID":"ef779192-a1a5-446e-9eb3-472d5871d0fb","Type":"ContainerStarted","Data":"0540404365f094de912d5bf9482ffca3804a1d0a2a3cbb7063e3ffad41b68a25"}
Jul 07 16:18:49.600442 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.600421    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szctq" event={"ID":"96fd75aa-b918-4566-a7e9-61e2d05a4082","Type":"ContainerStarted","Data":"3e8c3dd2e2ebd41d111c09244dd5eb984125eb4d9cb2af2f956cc671670a8bff"}
Jul 07 16:18:49.604896 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.604875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd" event={"ID":"2485ebb9-a662-47cc-95b3-7ee9191755f4","Type":"ContainerStarted","Data":"de117b8e29879cb8b647b54dcb7186c43808ab5e0a49ebf29e2069a39c19812d"}
Jul 07 16:18:49.605093 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.605065    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd" event={"ID":"2485ebb9-a662-47cc-95b3-7ee9191755f4","Type":"ContainerStarted","Data":"8320bfe87d1e27d70487cc22c31f6695423f94bec9c618468c8edcf9aec16402"}
Jul 07 16:18:49.605255 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.605227    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd" event={"ID":"2485ebb9-a662-47cc-95b3-7ee9191755f4","Type":"ContainerStarted","Data":"d4cd3e0869e2d6307d1830339b0ea2a83abf63ccddbe95c41bb1009e05209115"}
Jul 07 16:18:49.605354 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.605282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd" event={"ID":"2485ebb9-a662-47cc-95b3-7ee9191755f4","Type":"ContainerStarted","Data":"78765325a6af66ee386e400b3b5e291a083bd4407e8ffaf93cadb74e2878eca7"}
Jul 07 16:18:49.605354 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.605325    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd" event={"ID":"2485ebb9-a662-47cc-95b3-7ee9191755f4","Type":"ContainerStarted","Data":"4177c0096cca8110678085adb90f176db6281ff5f7d691379f4417fe20733f00"}
Jul 07 16:18:49.605454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.605367    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd" event={"ID":"2485ebb9-a662-47cc-95b3-7ee9191755f4","Type":"ContainerStarted","Data":"6e6ab04c7ee2f991364dabd2a456e6cef4c83c20a831a54295cda0c38905c80c"}
Jul 07 16:18:49.616106 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.616053    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-99.ec2.internal" podStartSLOduration=21.616037457 podStartE2EDuration="21.616037457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:32.58113849 +0000 UTC m=+5.935423739" watchObservedRunningTime="2026-07-07 16:18:49.616037457 +0000 UTC m=+22.970322707"
Jul 07 16:18:49.639483 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.639443    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6djm2" podStartSLOduration=8.467751606 podStartE2EDuration="22.639429584s" totalImagesPullingTime="14.171677978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:49.63932974 +0000 UTC m=+22.993614988" watchObservedRunningTime="2026-07-07 16:18:49.639429584 +0000 UTC m=+22.993714809"
Jul 07 16:18:49.639633 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.639613    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zt4dm" podStartSLOduration=4.080353289 podStartE2EDuration="22.639609118s" totalImagesPullingTime="18.559255829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:49.621827682 +0000 UTC m=+22.976112921" watchObservedRunningTime="2026-07-07 16:18:49.639609118 +0000 UTC m=+22.993894380"
Jul 07 16:18:49.655795 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.655759    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xqh4g" podStartSLOduration=8.47630904 podStartE2EDuration="22.655746095s" totalImagesPullingTime="14.179437055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:49.655435132 +0000 UTC m=+23.009720390" watchObservedRunningTime="2026-07-07 16:18:49.655746095 +0000 UTC m=+23.010031342"
Jul 07 16:18:49.682170 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.682077    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-szctq" podStartSLOduration=4.176976475 podStartE2EDuration="22.682058656s" totalImagesPullingTime="18.505082181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:49.68141761 +0000 UTC m=+23.035702855" watchObservedRunningTime="2026-07-07 16:18:49.682058656 +0000 UTC m=+23.036343905"
Jul 07 16:18:49.699894 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.699833    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l4g2p" podStartSLOduration=4.199719133 podStartE2EDuration="22.699820167s" totalImagesPullingTime="18.500101034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:49.698507624 +0000 UTC m=+23.052792872" watchObservedRunningTime="2026-07-07 16:18:49.699820167 +0000 UTC m=+23.054105414"
Jul 07 16:18:49.783124 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.783067    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:49.922610 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:49.922582    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:50.018616 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.018545    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:50.381444 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.381418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:50.381678 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:50.381510    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:50.381678 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.381572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:50.381678 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:50.381668    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:50.473869 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.473827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:50.556324 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.556289    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:50.609456 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.609395    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-m7q6n" event={"ID":"4b356c87-bfb6-4dbd-80c9-69d09c1899f2","Type":"ContainerStarted","Data":"ead7bc35ecd14569277e2ad45a32ad5192d857c957d76bcf822a515cc325931b"}
Jul 07 16:18:50.623882 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.623858    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 16:18:50.627046 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.627002    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-m7q6n" podStartSLOduration=5.132128171 podStartE2EDuration="23.626986762s" totalImagesPullingTime="18.494858591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:50.626520267 +0000 UTC m=+23.980805516" watchObservedRunningTime="2026-07-07 16:18:50.626986762 +0000 UTC m=+23.981272035"
Jul 07 16:18:50.705139 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.705099    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:50.802547 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.802516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:50.909052 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.908969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:50.978058 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.978016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:50.983976 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:50.983955    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:51.092328 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:51.092290    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:51.191509 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:51.191406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:51.261766 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:51.261658    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:18:50.623875726Z","UUID":"ce5d454f-512f-4ee6-b1bb-67f30229ce1b","Handler":null,"Name":"","Endpoint":""}
Jul 07 16:18:51.263242 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:51.263220    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 16:18:51.263373 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:51.263262    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 16:18:51.380930 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:51.380901    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:51.381096 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:51.381037    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:51.615630 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:51.615596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98" event={"ID":"58b50554-805f-494c-9743-e0c710481d85","Type":"ContainerStarted","Data":"2496ada51541071c5bfb694a27ae11e45167a4f3da276ae3dedc3d6abb6c5e5c"}
Jul 07 16:18:52.380887 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:52.380701    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:52.381071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:52.380751    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:52.381071 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:52.380960    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:52.381071 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:52.381042    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:52.621444 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:52.621403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd" event={"ID":"2485ebb9-a662-47cc-95b3-7ee9191755f4","Type":"ContainerStarted","Data":"cb09ecec8476311cbd5295553eb564e01aa6fc494e2203bb1d67cf0e7e21c750"}
Jul 07 16:18:52.623935 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:52.623904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98" event={"ID":"58b50554-805f-494c-9743-e0c710481d85","Type":"ContainerStarted","Data":"dfd5e9ea1b967771e0de0c420f3c0843339b667ce1d15d28ac8bde96775bba4f"}
Jul 07 16:18:52.643822 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:52.643749    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qsz98" podStartSLOduration=4.681973102 podStartE2EDuration="25.643736381s" totalImagesPullingTime="20.961763279s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:52.643353313 +0000 UTC m=+25.997638562" watchObservedRunningTime="2026-07-07 16:18:52.643736381 +0000 UTC m=+25.998021628"
Jul 07 16:18:52.865782 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:52.865752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:53.381088 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:53.381059    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:53.381274 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:53.381198    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:53.799355 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:53.799274    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:53.800015 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:53.799817    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:54.381081 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:54.381045    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:54.381268 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:54.381178    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:54.381268 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:54.381230    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:54.381380 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:54.381344    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:54.628498 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:54.628473    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6djm2"
Jul 07 16:18:54.709029 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:54.708945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:55.380758 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:55.380740    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:55.381161 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:55.380848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:55.633579 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:55.633420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd" event={"ID":"2485ebb9-a662-47cc-95b3-7ee9191755f4","Type":"ContainerStarted","Data":"9f594d1667a9db484bba676685f5705c6fbc1813f5f79adbe6a58e9f568b5d22"}
Jul 07 16:18:55.650338 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:55.650313    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:55.650450 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:55.650401    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:55.668152 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:55.668130    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:55.683074 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:55.683030    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd" podStartSLOduration=10.094600914 podStartE2EDuration="28.683017371s" totalImagesPullingTime="18.588416457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:18:55.682444824 +0000 UTC m=+29.036730072" watchObservedRunningTime="2026-07-07 16:18:55.683017371 +0000 UTC m=+29.037302618"
Jul 07 16:18:56.381081 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:56.381052    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:56.381081 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:56.381082    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:56.381525 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:56.381148    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:56.381525 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:56.381209    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:56.637957 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:56.637890    2563 generic.go:356] "Generic (PLEG): container finished" podID="e598bd7d-c404-45fd-a7d2-f7deb99c4970" containerID="93b0cb9606258423b57bab8a797e6cf3ecad5add85b58232ad179487ffa33470" exitCode=0
Jul 07 16:18:56.638127 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:56.637968    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8q64" event={"ID":"e598bd7d-c404-45fd-a7d2-f7deb99c4970","Type":"ContainerDied","Data":"93b0cb9606258423b57bab8a797e6cf3ecad5add85b58232ad179487ffa33470"}
Jul 07 16:18:56.638344 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:56.638310    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:56.655540 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:56.655517    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:18:57.070318 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:57.070237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:57.167686 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:57.167654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:57.351612 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:57.351543    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8nzc"]
Jul 07 16:18:57.351754 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:57.351678    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:57.351797 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:57.351759    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:57.355191 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:57.355156    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kgchl"]
Jul 07 16:18:57.355323 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:57.355273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:57.355396 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:57.355367    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:57.355777 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:57.355756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z56bk"]
Jul 07 16:18:57.355936 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:57.355923    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:57.356034 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:57.356016    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:58.622856 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:58.622673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:58.643630 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:58.643603    2563 generic.go:356] "Generic (PLEG): container finished" podID="e598bd7d-c404-45fd-a7d2-f7deb99c4970" containerID="9dbed7a306b5359026a5fa8c362aed86dcc25fdbf49736507fb5b12a5889caae" exitCode=0
Jul 07 16:18:58.643758 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:58.643684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8q64" event={"ID":"e598bd7d-c404-45fd-a7d2-f7deb99c4970","Type":"ContainerDied","Data":"9dbed7a306b5359026a5fa8c362aed86dcc25fdbf49736507fb5b12a5889caae"}
Jul 07 16:18:58.702280 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:58.702254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:58.998518 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:58.998485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:59.059768 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:59.059739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:18:59.381365 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:59.381334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:18:59.381537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:59.381334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:18:59.381537 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:59.381461    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:18:59.381537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:59.381334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:18:59.381537 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:59.381515    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:18:59.381746 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:18:59.381579    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:18:59.648059 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:59.647988    2563 generic.go:356] "Generic (PLEG): container finished" podID="e598bd7d-c404-45fd-a7d2-f7deb99c4970" containerID="f3d9bfea1e10af454c133d54d7fc9e07caf6d174c6c2c701449cb4dd09509daa" exitCode=0
Jul 07 16:18:59.648059 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:18:59.648030    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8q64" event={"ID":"e598bd7d-c404-45fd-a7d2-f7deb99c4970","Type":"ContainerDied","Data":"f3d9bfea1e10af454c133d54d7fc9e07caf6d174c6c2c701449cb4dd09509daa"}
Jul 07 16:19:00.903060 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:00.903028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:19:00.903496 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:00.903073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:19:00.903496 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:00.903199    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 16:19:00.903496 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:00.903225    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:19:00.903496 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:00.903280    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret podName:8e12111d-b924-495e-b09b-7c40400657d8 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:32.903257743 +0000 UTC m=+66.257542991 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret") pod "global-pull-secret-syncer-t8nzc" (UID: "8e12111d-b924-495e-b09b-7c40400657d8") : object "kube-system"/"original-pull-secret" not registered
Jul 07 16:19:00.903496 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:00.903302    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs podName:d6abe5ea-e22a-4433-ad26-2eb34a71290d nodeName:}" failed. No retries permitted until 2026-07-07 16:19:32.903290342 +0000 UTC m=+66.257575569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs") pod "network-metrics-daemon-kgchl" (UID: "d6abe5ea-e22a-4433-ad26-2eb34a71290d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 16:19:01.004399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:01.004357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jtz\" (UniqueName: \"kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz\") pod \"network-check-target-z56bk\" (UID: \"a32c936b-17f3-4ceb-abdd-255c91ee33ef\") " pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:19:01.004570 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:01.004515    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 16:19:01.004570 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:01.004535    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 16:19:01.004570 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:01.004548    2563 projected.go:196] Error preparing data for projected volume kube-api-access-52jtz for pod openshift-network-diagnostics/network-check-target-z56bk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:19:01.004743 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:01.004614    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz podName:a32c936b-17f3-4ceb-abdd-255c91ee33ef nodeName:}" failed. No retries permitted until 2026-07-07 16:19:33.004595154 +0000 UTC m=+66.358880400 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-52jtz" (UniqueName: "kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz") pod "network-check-target-z56bk" (UID: "a32c936b-17f3-4ceb-abdd-255c91ee33ef") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 16:19:01.212805 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:01.212658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:01.276881 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:01.276829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:01.381168 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:01.381143    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:19:01.381322 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:01.381143    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:19:01.381322 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:01.381246    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z56bk" podUID="a32c936b-17f3-4ceb-abdd-255c91ee33ef"
Jul 07 16:19:01.381391 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:01.381329    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kgchl" podUID="d6abe5ea-e22a-4433-ad26-2eb34a71290d"
Jul 07 16:19:01.381391 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:01.381144    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:19:01.381450 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:01.381406    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8nzc" podUID="8e12111d-b924-495e-b09b-7c40400657d8"
Jul 07 16:19:01.939573 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:01.939542    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-99.ec2.internal" event="NodeReady"
Jul 07 16:19:01.940036 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:01.939657    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 16:19:01.997900 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:01.997869    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fv955"]
Jul 07 16:19:02.001264 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.001247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fv955"
Jul 07 16:19:02.010104 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.010085    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wft9m"]
Jul 07 16:19:02.013967 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.013939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.015251 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.015229    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fv955"]
Jul 07 16:19:02.021945 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.021925    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 16:19:02.022171 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.022156    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 16:19:02.022255 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.022229    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 16:19:02.022322 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.022264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5hz4f\""
Jul 07 16:19:02.022506 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.022493    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 16:19:02.033795 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.033768    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 16:19:02.037345 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.037328    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wft9m"]
Jul 07 16:19:02.044333 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.044319    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2sv27\""
Jul 07 16:19:02.112759 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.112730    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52347fbd-246a-4419-9cd6-9393930aa41a-config-volume\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.112941 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.112769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.112941 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.112790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cpn7\" (UniqueName: \"kubernetes.io/projected/0f195809-b971-4983-ac73-6002fc3a10a0-kube-api-access-2cpn7\") pod \"ingress-canary-fv955\" (UID: \"0f195809-b971-4983-ac73-6002fc3a10a0\") " pod="openshift-ingress-canary/ingress-canary-fv955"
Jul 07 16:19:02.112941 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.112868    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52347fbd-246a-4419-9cd6-9393930aa41a-tmp-dir\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.113075 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.112992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngszr\" (UniqueName: \"kubernetes.io/projected/52347fbd-246a-4419-9cd6-9393930aa41a-kube-api-access-ngszr\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.113075 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.113027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f195809-b971-4983-ac73-6002fc3a10a0-cert\") pod \"ingress-canary-fv955\" (UID: \"0f195809-b971-4983-ac73-6002fc3a10a0\") " pod="openshift-ingress-canary/ingress-canary-fv955"
Jul 07 16:19:02.192221 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.192152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:02.214200 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.214177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.214292 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.214206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cpn7\" (UniqueName: \"kubernetes.io/projected/0f195809-b971-4983-ac73-6002fc3a10a0-kube-api-access-2cpn7\") pod \"ingress-canary-fv955\" (UID: \"0f195809-b971-4983-ac73-6002fc3a10a0\") " pod="openshift-ingress-canary/ingress-canary-fv955"
Jul 07 16:19:02.214292 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.214235    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52347fbd-246a-4419-9cd6-9393930aa41a-tmp-dir\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.214292 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.214276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngszr\" (UniqueName: \"kubernetes.io/projected/52347fbd-246a-4419-9cd6-9393930aa41a-kube-api-access-ngszr\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.214428 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.214295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f195809-b971-4983-ac73-6002fc3a10a0-cert\") pod \"ingress-canary-fv955\" (UID: \"0f195809-b971-4983-ac73-6002fc3a10a0\") " pod="openshift-ingress-canary/ingress-canary-fv955"
Jul 07 16:19:02.214428 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:02.214314    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:19:02.214428 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.214316    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52347fbd-246a-4419-9cd6-9393930aa41a-config-volume\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.214428 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:02.214372    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls podName:52347fbd-246a-4419-9cd6-9393930aa41a nodeName:}" failed. No retries permitted until 2026-07-07 16:19:02.71435804 +0000 UTC m=+36.068643266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls") pod "dns-default-wft9m" (UID: "52347fbd-246a-4419-9cd6-9393930aa41a") : secret "dns-default-metrics-tls" not found
Jul 07 16:19:02.214692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.214671    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52347fbd-246a-4419-9cd6-9393930aa41a-tmp-dir\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.214965 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.214945    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52347fbd-246a-4419-9cd6-9393930aa41a-config-volume\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.218540 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.218514    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f195809-b971-4983-ac73-6002fc3a10a0-cert\") pod \"ingress-canary-fv955\" (UID: \"0f195809-b971-4983-ac73-6002fc3a10a0\") " pod="openshift-ingress-canary/ingress-canary-fv955"
Jul 07 16:19:02.223670 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.223634    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngszr\" (UniqueName: \"kubernetes.io/projected/52347fbd-246a-4419-9cd6-9393930aa41a-kube-api-access-ngszr\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.223768 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.223744    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cpn7\" (UniqueName: \"kubernetes.io/projected/0f195809-b971-4983-ac73-6002fc3a10a0-kube-api-access-2cpn7\") pod \"ingress-canary-fv955\" (UID: \"0f195809-b971-4983-ac73-6002fc3a10a0\") " pod="openshift-ingress-canary/ingress-canary-fv955"
Jul 07 16:19:02.292037 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.292004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:02.309876 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.309850    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fv955"
Jul 07 16:19:02.451297 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.451045    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fv955"]
Jul 07 16:19:02.455518 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:02.455490    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f195809_b971_4983_ac73_6002fc3a10a0.slice/crio-ee3f6189ca2d40916beff68fa694e28fb662c59d65b9a796aa33d58250375965 WatchSource:0}: Error finding container ee3f6189ca2d40916beff68fa694e28fb662c59d65b9a796aa33d58250375965: Status 404 returned error can't find the container with id ee3f6189ca2d40916beff68fa694e28fb662c59d65b9a796aa33d58250375965
Jul 07 16:19:02.661011 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.660973    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fv955" event={"ID":"0f195809-b971-4983-ac73-6002fc3a10a0","Type":"ContainerStarted","Data":"ee3f6189ca2d40916beff68fa694e28fb662c59d65b9a796aa33d58250375965"}
Jul 07 16:19:02.718430 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:02.718338    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:02.718569 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:02.718491    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:19:02.718569 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:02.718550    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls podName:52347fbd-246a-4419-9cd6-9393930aa41a nodeName:}" failed. No retries permitted until 2026-07-07 16:19:03.718532932 +0000 UTC m=+37.072818165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls") pod "dns-default-wft9m" (UID: "52347fbd-246a-4419-9cd6-9393930aa41a") : secret "dns-default-metrics-tls" not found
Jul 07 16:19:03.347246 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.347207    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c"]
Jul 07 16:19:03.352075 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.352051    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c"
Jul 07 16:19:03.355418 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.355397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rs4rx\""
Jul 07 16:19:03.356691 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.356663    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 16:19:03.356829 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.356806    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 16:19:03.359460 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.359330    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c"]
Jul 07 16:19:03.381126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.381018    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:19:03.381252 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.381056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:19:03.381252 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.381079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:19:03.384615 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.384397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 16:19:03.384615 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.384441    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nbnd\""
Jul 07 16:19:03.384769 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.384667    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68hwt\""
Jul 07 16:19:03.384961 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.384885    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 16:19:03.525043 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.525011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8qkx\" (UniqueName: \"kubernetes.io/projected/3c68bf6b-f59a-439f-9320-d2ea2d2793c0-kube-api-access-n8qkx\") pod \"network-check-source-989f8b8dc-cv75c\" (UID: \"3c68bf6b-f59a-439f-9320-d2ea2d2793c0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c"
Jul 07 16:19:03.625620 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.625590    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8qkx\" (UniqueName: \"kubernetes.io/projected/3c68bf6b-f59a-439f-9320-d2ea2d2793c0-kube-api-access-n8qkx\") pod \"network-check-source-989f8b8dc-cv75c\" (UID: \"3c68bf6b-f59a-439f-9320-d2ea2d2793c0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c"
Jul 07 16:19:03.637830 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.637805    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8qkx\" (UniqueName: \"kubernetes.io/projected/3c68bf6b-f59a-439f-9320-d2ea2d2793c0-kube-api-access-n8qkx\") pod \"network-check-source-989f8b8dc-cv75c\" (UID: \"3c68bf6b-f59a-439f-9320-d2ea2d2793c0\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c"
Jul 07 16:19:03.665511 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.664928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c"
Jul 07 16:19:03.712434 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.712396    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:03.726938 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.726913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:03.727084 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:03.727044    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:19:03.727156 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:03.727104    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls podName:52347fbd-246a-4419-9cd6-9393930aa41a nodeName:}" failed. No retries permitted until 2026-07-07 16:19:05.727086689 +0000 UTC m=+39.081371917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls") pod "dns-default-wft9m" (UID: "52347fbd-246a-4419-9cd6-9393930aa41a") : secret "dns-default-metrics-tls" not found
Jul 07 16:19:03.812573 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:03.812489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:05.466568 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:05.466520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:05.563085 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:05.563045    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:05.743021 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:05.742940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:05.743163 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:05.743092    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:19:05.743163 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:05.743154    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls podName:52347fbd-246a-4419-9cd6-9393930aa41a nodeName:}" failed. No retries permitted until 2026-07-07 16:19:09.743139811 +0000 UTC m=+43.097425041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls") pod "dns-default-wft9m" (UID: "52347fbd-246a-4419-9cd6-9393930aa41a") : secret "dns-default-metrics-tls" not found
Jul 07 16:19:06.025192 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.025013    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9vn2v"]
Jul 07 16:19:06.034751 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.034728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.038051 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.037906    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 16:19:06.038464 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.038330    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 16:19:06.039443 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.039212    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 16:19:06.039443 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.039251    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmpnl\""
Jul 07 16:19:06.039573 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.039458    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 16:19:06.043159 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.043136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9vn2v"]
Jul 07 16:19:06.065133 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.065075    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:06.102431 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.102406    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c"]
Jul 07 16:19:06.105817 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:06.105789    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c68bf6b_f59a_439f_9320_d2ea2d2793c0.slice/crio-b327dd39b818032a75563679875cb93e12667817258558e5586e56644349ffa8 WatchSource:0}: Error finding container b327dd39b818032a75563679875cb93e12667817258558e5586e56644349ffa8: Status 404 returned error can't find the container with id b327dd39b818032a75563679875cb93e12667817258558e5586e56644349ffa8
Jul 07 16:19:06.144085 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.144055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:06.146095 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.146062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-data-volume\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.146095 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.146092    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.146278 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.146117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2sbp\" (UniqueName: \"kubernetes.io/projected/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-api-access-f2sbp\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.146278 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.146145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.146346 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.146298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-crio-socket\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.246749 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.246680    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.246749 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.246719    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2sbp\" (UniqueName: \"kubernetes.io/projected/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-api-access-f2sbp\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.246749 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.246744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.247019 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.246796    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-crio-socket\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.247019 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:06.246800    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:06.247019 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:06.246885    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:19:06.247019 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:06.246918    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:06.746883413 +0000 UTC m=+40.101168658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:06.247019 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:06.246950    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:06.746931523 +0000 UTC m=+40.101216771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : configmap "kube-rbac-proxy" not found
Jul 07 16:19:06.247019 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.246988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-data-volume\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.247019 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.246998    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-crio-socket\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.247251 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.247240    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-data-volume\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.256752 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.256729    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2sbp\" (UniqueName: \"kubernetes.io/projected/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-api-access-f2sbp\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.552767 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.552690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:06.556128 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.556103    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw"]
Jul 07 16:19:06.579763 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.579731    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw"]
Jul 07 16:19:06.579888 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.579872    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw"
Jul 07 16:19:06.582680 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.582656    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 16:19:06.582788 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.582667    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8wss4\""
Jul 07 16:19:06.584033 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.584012    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 16:19:06.642064 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.642035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:06.673922 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.673898    2563 generic.go:356] "Generic (PLEG): container finished" podID="e598bd7d-c404-45fd-a7d2-f7deb99c4970" containerID="3fd7f67fe1a39a2cc535377615759f1c2a5bd054b0cf21874e03eedb3b17f9fb" exitCode=0
Jul 07 16:19:06.674024 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.673955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8q64" event={"ID":"e598bd7d-c404-45fd-a7d2-f7deb99c4970","Type":"ContainerDied","Data":"3fd7f67fe1a39a2cc535377615759f1c2a5bd054b0cf21874e03eedb3b17f9fb"}
Jul 07 16:19:06.675529 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.675507    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fv955" event={"ID":"0f195809-b971-4983-ac73-6002fc3a10a0","Type":"ContainerStarted","Data":"ea6a43591048ec7a04275353515d393f41728c5bed5ced958076fbfc85acba9c"}
Jul 07 16:19:06.676524 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.676498    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c" event={"ID":"3c68bf6b-f59a-439f-9320-d2ea2d2793c0","Type":"ContainerStarted","Data":"b327dd39b818032a75563679875cb93e12667817258558e5586e56644349ffa8"}
Jul 07 16:19:06.718190 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.718149    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fv955" podStartSLOduration=2.205369949 podStartE2EDuration="5.718135753s" totalImagesPullingTime="3.512765804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:06.717109996 +0000 UTC m=+40.071395243" watchObservedRunningTime="2026-07-07 16:19:06.718135753 +0000 UTC m=+40.072420979"
Jul 07 16:19:06.721868 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.721829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:06.751248 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.751168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.751248 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.751231    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:06.751413 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:06.751392    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:06.751521 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:06.751467    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:07.751449936 +0000 UTC m=+41.105735177 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:06.751521 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:06.751509    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:19:06.751646 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.751493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6lk4\" (UniqueName: \"kubernetes.io/projected/5e8793fa-f3cd-4712-bb95-29907af85258-kube-api-access-b6lk4\") pod \"migrator-d57d58cc9-f46tw\" (UID: \"5e8793fa-f3cd-4712-bb95-29907af85258\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw"
Jul 07 16:19:06.751646 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:06.751573    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:07.75155422 +0000 UTC m=+41.105839464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : configmap "kube-rbac-proxy" not found
Jul 07 16:19:06.852943 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.852902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6lk4\" (UniqueName: \"kubernetes.io/projected/5e8793fa-f3cd-4712-bb95-29907af85258-kube-api-access-b6lk4\") pod \"migrator-d57d58cc9-f46tw\" (UID: \"5e8793fa-f3cd-4712-bb95-29907af85258\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw"
Jul 07 16:19:06.861781 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.861755    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6lk4\" (UniqueName: \"kubernetes.io/projected/5e8793fa-f3cd-4712-bb95-29907af85258-kube-api-access-b6lk4\") pod \"migrator-d57d58cc9-f46tw\" (UID: \"5e8793fa-f3cd-4712-bb95-29907af85258\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw"
Jul 07 16:19:06.889267 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:06.889247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw"
Jul 07 16:19:07.025412 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.025382    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw"]
Jul 07 16:19:07.028448 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:07.028414    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e8793fa_f3cd_4712_bb95_29907af85258.slice/crio-cae3a78c2db09e9a3bf670cdc1f479df45f104d9be589f4438f2254ea3a72126 WatchSource:0}: Error finding container cae3a78c2db09e9a3bf670cdc1f479df45f104d9be589f4438f2254ea3a72126: Status 404 returned error can't find the container with id cae3a78c2db09e9a3bf670cdc1f479df45f104d9be589f4438f2254ea3a72126
Jul 07 16:19:07.107430 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.107344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:07.543020 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.542971    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:07.611011 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.610980    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:07.680635 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.680595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw" event={"ID":"5e8793fa-f3cd-4712-bb95-29907af85258","Type":"ContainerStarted","Data":"cae3a78c2db09e9a3bf670cdc1f479df45f104d9be589f4438f2254ea3a72126"}
Jul 07 16:19:07.684111 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.684084    2563 generic.go:356] "Generic (PLEG): container finished" podID="e598bd7d-c404-45fd-a7d2-f7deb99c4970" containerID="e31c5b7583f2179512a06b6410e720b9f133fe2ebc6d0dff026992573f48a4a4" exitCode=0
Jul 07 16:19:07.684210 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.684130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8q64" event={"ID":"e598bd7d-c404-45fd-a7d2-f7deb99c4970","Type":"ContainerDied","Data":"e31c5b7583f2179512a06b6410e720b9f133fe2ebc6d0dff026992573f48a4a4"}
Jul 07 16:19:07.760256 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.760224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:07.760407 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.760281    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:07.760460 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:07.760426    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:19:07.760508 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:07.760500    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:09.760479817 +0000 UTC m=+43.114765060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : configmap "kube-rbac-proxy" not found
Jul 07 16:19:07.760768 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:07.760663    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:07.760768 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:07.760741    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:09.760722803 +0000 UTC m=+43.115008049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:07.856737 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.856712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:07.960339 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:07.960288    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:08.200579 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.200552    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xqh4g_48e6664e-d120-47c3-bd5b-c51e68bc47cb/dns-node-resolver/0.log"
Jul 07 16:19:08.361910 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.361879    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"]
Jul 07 16:19:08.380316 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.380144    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"]
Jul 07 16:19:08.380316 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.380266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:08.383291 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.383264    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 16:19:08.383291 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.383281    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6f5kb\""
Jul 07 16:19:08.383483 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.383272    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 16:19:08.486759 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.486696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:08.553769 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.553734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:08.567889 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.567856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/876c12c7-fafd-42ae-beb9-1bdd5b938820-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:08.568035 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.567945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:08.669414 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.669372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:08.669864 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.669533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/876c12c7-fafd-42ae-beb9-1bdd5b938820-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:08.670421 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.670396    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/876c12c7-fafd-42ae-beb9-1bdd5b938820-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:08.670550 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:08.670535    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:19:08.670617 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:08.670607    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert podName:876c12c7-fafd-42ae-beb9-1bdd5b938820 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:09.170588021 +0000 UTC m=+42.524873253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-t56mf" (UID: "876c12c7-fafd-42ae-beb9-1bdd5b938820") : secret "networking-console-plugin-cert" not found
Jul 07 16:19:08.690500 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.690465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-n8q64" event={"ID":"e598bd7d-c404-45fd-a7d2-f7deb99c4970","Type":"ContainerStarted","Data":"0963566b8824ce85bbebf0e17b5eaffd733d19549f41addfd687765d0b9d21a8"}
Jul 07 16:19:08.718870 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:08.718800    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-n8q64" podStartSLOduration=9.185099893 podStartE2EDuration="41.71877969s" totalImagesPullingTime="32.533679797s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:08.716806371 +0000 UTC m=+42.071091620" watchObservedRunningTime="2026-07-07 16:19:08.71877969 +0000 UTC m=+42.073064940"
Jul 07 16:19:09.000250 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.000220    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l4g2p_ef779192-a1a5-446e-9eb3-472d5871d0fb/node-ca/0.log"
Jul 07 16:19:09.173749 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.173705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:09.173942 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:09.173876    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:19:09.174202 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:09.173954    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert podName:876c12c7-fafd-42ae-beb9-1bdd5b938820 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:10.173933712 +0000 UTC m=+43.528218961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-t56mf" (UID: "876c12c7-fafd-42ae-beb9-1bdd5b938820") : secret "networking-console-plugin-cert" not found
Jul 07 16:19:09.238764 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.238736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:09.351119 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.351090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:09.454008 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.453977    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n5nrd"]
Jul 07 16:19:09.472906 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.472879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n5nrd"]
Jul 07 16:19:09.473052 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.472983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.476064 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.476044    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 16:19:09.476173 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.476054    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 16:19:09.476173 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.476042    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 16:19:09.477296 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.477276    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6lt64\""
Jul 07 16:19:09.477376 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.477317    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 16:19:09.510469 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.510413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:09.576650 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.576622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7d23652c-c25e-4289-854b-89355c591ffe-signing-key\") pod \"service-ca-758f599c5-n5nrd\" (UID: \"7d23652c-c25e-4289-854b-89355c591ffe\") " pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.576785 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.576674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c22l\" (UniqueName: \"kubernetes.io/projected/7d23652c-c25e-4289-854b-89355c591ffe-kube-api-access-9c22l\") pod \"service-ca-758f599c5-n5nrd\" (UID: \"7d23652c-c25e-4289-854b-89355c591ffe\") " pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.576785 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.576720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7d23652c-c25e-4289-854b-89355c591ffe-signing-cabundle\") pod \"service-ca-758f599c5-n5nrd\" (UID: \"7d23652c-c25e-4289-854b-89355c591ffe\") " pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.600460 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.600435    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:09.677737 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.677710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7d23652c-c25e-4289-854b-89355c591ffe-signing-cabundle\") pod \"service-ca-758f599c5-n5nrd\" (UID: \"7d23652c-c25e-4289-854b-89355c591ffe\") " pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.678146 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.677815    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7d23652c-c25e-4289-854b-89355c591ffe-signing-key\") pod \"service-ca-758f599c5-n5nrd\" (UID: \"7d23652c-c25e-4289-854b-89355c591ffe\") " pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.678146 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.677903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c22l\" (UniqueName: \"kubernetes.io/projected/7d23652c-c25e-4289-854b-89355c591ffe-kube-api-access-9c22l\") pod \"service-ca-758f599c5-n5nrd\" (UID: \"7d23652c-c25e-4289-854b-89355c591ffe\") " pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.678352 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.678335    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/7d23652c-c25e-4289-854b-89355c591ffe-signing-cabundle\") pod \"service-ca-758f599c5-n5nrd\" (UID: \"7d23652c-c25e-4289-854b-89355c591ffe\") " pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.680075 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.680058    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/7d23652c-c25e-4289-854b-89355c591ffe-signing-key\") pod \"service-ca-758f599c5-n5nrd\" (UID: \"7d23652c-c25e-4289-854b-89355c591ffe\") " pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.686767 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.686748    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c22l\" (UniqueName: \"kubernetes.io/projected/7d23652c-c25e-4289-854b-89355c591ffe-kube-api-access-9c22l\") pod \"service-ca-758f599c5-n5nrd\" (UID: \"7d23652c-c25e-4289-854b-89355c591ffe\") " pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.694155 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.694121    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw" event={"ID":"5e8793fa-f3cd-4712-bb95-29907af85258","Type":"ContainerStarted","Data":"9aa7b50a2bbd2ce4b4b47af8d803df44dba024b691d435bfbde47c3897bff0d3"}
Jul 07 16:19:09.694240 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.694185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw" event={"ID":"5e8793fa-f3cd-4712-bb95-29907af85258","Type":"ContainerStarted","Data":"fd5e51cad66da55e19438ab85026a237a91b5c53b4aba23999f86a19cf4a9903"}
Jul 07 16:19:09.699950 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.699930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:09.712623 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.712584    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f46tw" podStartSLOduration=1.591660769 podStartE2EDuration="3.712572251s" totalImagesPullingTime="2.120911482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:09.712022467 +0000 UTC m=+43.066307734" watchObservedRunningTime="2026-07-07 16:19:09.712572251 +0000 UTC m=+43.066857498"
Jul 07 16:19:09.778292 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.778224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:09.778422 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.778307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:09.778422 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.778344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:09.778422 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:09.778395    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:19:09.778571 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:09.778423    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:19:09.778571 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:09.778442    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:09.778571 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:09.778481    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls podName:52347fbd-246a-4419-9cd6-9393930aa41a nodeName:}" failed. No retries permitted until 2026-07-07 16:19:17.778461267 +0000 UTC m=+51.132746496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls") pod "dns-default-wft9m" (UID: "52347fbd-246a-4419-9cd6-9393930aa41a") : secret "dns-default-metrics-tls" not found
Jul 07 16:19:09.778571 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:09.778502    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:13.77849204 +0000 UTC m=+47.132777269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:09.778571 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:09.778520    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:13.778511625 +0000 UTC m=+47.132796857 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : configmap "kube-rbac-proxy" not found
Jul 07 16:19:09.783206 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.783191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-n5nrd"
Jul 07 16:19:09.803819 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.803799    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fv955_0f195809-b971-4983-ac73-6002fc3a10a0/serve-healthcheck-canary/0.log"
Jul 07 16:19:09.803990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.803934    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:09.901815 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.901784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:09.933236 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:09.933212    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-n5nrd"]
Jul 07 16:19:09.936548 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:09.936517    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d23652c_c25e_4289_854b_89355c591ffe.slice/crio-3b8cb84ac59673e4ccf70bb8859f939ae9abc898bc2478cfd71b3f59cfa3986f WatchSource:0}: Error finding container 3b8cb84ac59673e4ccf70bb8859f939ae9abc898bc2478cfd71b3f59cfa3986f: Status 404 returned error can't find the container with id 3b8cb84ac59673e4ccf70bb8859f939ae9abc898bc2478cfd71b3f59cfa3986f
Jul 07 16:19:10.181248 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:10.181210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:10.181402 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:10.181362    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:19:10.181447 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:10.181423    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert podName:876c12c7-fafd-42ae-beb9-1bdd5b938820 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:12.181408019 +0000 UTC m=+45.535693245 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-t56mf" (UID: "876c12c7-fafd-42ae-beb9-1bdd5b938820") : secret "networking-console-plugin-cert" not found
Jul 07 16:19:10.590064 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:10.589988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:10.698648 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:10.698611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-n5nrd" event={"ID":"7d23652c-c25e-4289-854b-89355c591ffe","Type":"ContainerStarted","Data":"3b8cb84ac59673e4ccf70bb8859f939ae9abc898bc2478cfd71b3f59cfa3986f"}
Jul 07 16:19:12.203782 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:12.203749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:12.204118 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:12.203911    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:19:12.204118 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:12.203978    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert podName:876c12c7-fafd-42ae-beb9-1bdd5b938820 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:16.20396091 +0000 UTC m=+49.558246136 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-t56mf" (UID: "876c12c7-fafd-42ae-beb9-1bdd5b938820") : secret "networking-console-plugin-cert" not found
Jul 07 16:19:13.707698 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:13.707656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c" event={"ID":"3c68bf6b-f59a-439f-9320-d2ea2d2793c0","Type":"ContainerStarted","Data":"faf9753e730c5a8ad89030db9b8eb4bfa893ed9b55d8b110ea286b7dc653df37"}
Jul 07 16:19:13.709176 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:13.709154    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-n5nrd" event={"ID":"7d23652c-c25e-4289-854b-89355c591ffe","Type":"ContainerStarted","Data":"db4a7b8dde2ed67722d4b1ab0d5389f2e319877c39865ede489e0313abf7661a"}
Jul 07 16:19:13.725161 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:13.725100    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cv75c" podStartSLOduration=4.679399108 podStartE2EDuration="10.725083601s" totalImagesPullingTime="6.045684493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:13.724751273 +0000 UTC m=+47.079036521" watchObservedRunningTime="2026-07-07 16:19:13.725083601 +0000 UTC m=+47.079368849"
Jul 07 16:19:13.741457 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:13.741407    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-n5nrd" podStartSLOduration=1.697139404 podStartE2EDuration="4.741392838s" totalImagesPullingTime="3.044253434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:13.740831263 +0000 UTC m=+47.095116512" watchObservedRunningTime="2026-07-07 16:19:13.741392838 +0000 UTC m=+47.095678087"
Jul 07 16:19:13.815540 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:13.815503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:13.815718 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:13.815553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:13.815718 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:13.815665    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:13.815718 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:13.815681    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 16:19:13.815892 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:13.815725    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:21.815713571 +0000 UTC m=+55.169998797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : configmap "kube-rbac-proxy" not found
Jul 07 16:19:13.815892 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:13.815739    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:21.815732479 +0000 UTC m=+55.170017705 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:14.408332 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:14.408287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:14.507652 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:14.507614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:14.753598 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:14.753500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:14.915797 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:14.915762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:15.026803 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:15.026721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:15.131905 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:15.131875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:15.218881 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:15.218817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:15.719754 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:15.719724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:16.235539 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:16.235506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:16.235928 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:16.235624    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 07 16:19:16.235928 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:16.235675    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert podName:876c12c7-fafd-42ae-beb9-1bdd5b938820 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:24.23566316 +0000 UTC m=+57.589948386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-t56mf" (UID: "876c12c7-fafd-42ae-beb9-1bdd5b938820") : secret "networking-console-plugin-cert" not found
Jul 07 16:19:16.521812 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:16.521732    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:16.747359 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:16.747326    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:17.129498 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:17.129468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:17.316777 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:17.316746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:17.717482 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:17.717411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:17.845720 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:17.845688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:17.845910 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:17.845805    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 16:19:17.845910 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:17.845879    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls podName:52347fbd-246a-4419-9cd6-9393930aa41a nodeName:}" failed. No retries permitted until 2026-07-07 16:19:33.845862656 +0000 UTC m=+67.200147887 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls") pod "dns-default-wft9m" (UID: "52347fbd-246a-4419-9cd6-9393930aa41a") : secret "dns-default-metrics-tls" not found
Jul 07 16:19:18.120731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:18.120692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:18.228882 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:18.228828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:18.348858 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:18.348802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:18.916678 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:18.916635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:19.123293 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:19.123261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:19.224033 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:19.223959    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:19.517414 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:19.517310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:19.719818 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:19.719776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:20.329111 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:20.329077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:20.468510 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:20.468469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:20.572605 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:20.572559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:20.681908 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:20.681877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:20.915422 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:20.915393    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:21.119105 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:21.119050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:21.330389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:21.330329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:21.719736 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:21.719692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:21.878893 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:21.878855    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:21.879054 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:21.878905    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:21.879054 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:21.879034    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:21.879139 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:21.879107    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls podName:10f7d95b-d9e6-426e-b4fc-1ac7290f37d7 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:37.879087922 +0000 UTC m=+71.233373167 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vn2v" (UID: "10f7d95b-d9e6-426e-b4fc-1ac7290f37d7") : secret "insights-runtime-extractor-tls" not found
Jul 07 16:19:21.879489 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:21.879468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:22.190157 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:22.190114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:22.320367 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:22.320340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:22.721476 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:22.721440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:23.114575 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:23.114540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:23.519304 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:23.519192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:23.715011 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:23.714985    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:24.127496 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:24.127466    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:24.298121 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:24.298085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:24.300427 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:24.300399    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/876c12c7-fafd-42ae-beb9-1bdd5b938820-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-t56mf\" (UID: \"876c12c7-fafd-42ae-beb9-1bdd5b938820\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:24.591816 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:24.591728    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"
Jul 07 16:19:24.713140 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:24.713111    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-t56mf"]
Jul 07 16:19:24.716898 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:24.716865    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876c12c7_fafd_42ae_beb9_1bdd5b938820.slice/crio-8ed34a2593547fbb8c010e96519347134d9f2a34b8217357738930637a722cee WatchSource:0}: Error finding container 8ed34a2593547fbb8c010e96519347134d9f2a34b8217357738930637a722cee: Status 404 returned error can't find the container with id 8ed34a2593547fbb8c010e96519347134d9f2a34b8217357738930637a722cee
Jul 07 16:19:24.719415 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:24.719385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:24.735687 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:24.735664    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf" event={"ID":"876c12c7-fafd-42ae-beb9-1bdd5b938820","Type":"ContainerStarted","Data":"8ed34a2593547fbb8c010e96519347134d9f2a34b8217357738930637a722cee"}
Jul 07 16:19:24.925028 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:24.924997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:25.130329 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:25.130292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:26.743184 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:26.743151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf" event={"ID":"876c12c7-fafd-42ae-beb9-1bdd5b938820","Type":"ContainerStarted","Data":"e417b52fcbe9330ae6cf9f9ce49909157f711cc09cfe931bad722f59d2494d31"}
Jul 07 16:19:26.760868 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:26.760800    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-t56mf" podStartSLOduration=17.18657288 podStartE2EDuration="18.760778601s" totalImagesPullingTime="1.574205721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:26.760324012 +0000 UTC m=+60.114609261" watchObservedRunningTime="2026-07-07 16:19:26.760778601 +0000 UTC m=+60.115063847"
Jul 07 16:19:28.653781 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:28.653755    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r2xjd"
Jul 07 16:19:29.729218 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.729188    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"]
Jul 07 16:19:29.731589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.731572    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"
Jul 07 16:19:29.748402 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.748376    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 16:19:29.749809 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.749783    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-v6t2s\""
Jul 07 16:19:29.749952 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.749810    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 16:19:29.749952 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.749810    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 07 16:19:29.752062 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.752045    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 16:19:29.781956 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.781930    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"]
Jul 07 16:19:29.786400 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.786371    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"]
Jul 07 16:19:29.788179 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.788161    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.802707 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.802688    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 16:19:29.802869 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.802853    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 16:19:29.803348 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.803334    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 16:19:29.814852 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.814820    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 16:19:29.840238 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.840215    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"]
Jul 07 16:19:29.842553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.842533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn8mj\" (UniqueName: \"kubernetes.io/projected/e5ddbc95-33bf-4b46-88f8-a4832a920ace-kube-api-access-xn8mj\") pod \"managed-serviceaccount-addon-agent-76685ccbdb-k84r7\" (UID: \"e5ddbc95-33bf-4b46-88f8-a4832a920ace\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"
Jul 07 16:19:29.842663 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.842560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkr9h\" (UniqueName: \"kubernetes.io/projected/51d890f2-548b-44ec-8d8a-b63721916baf-kube-api-access-fkr9h\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.842663 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.842593    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5ddbc95-33bf-4b46-88f8-a4832a920ace-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76685ccbdb-k84r7\" (UID: \"e5ddbc95-33bf-4b46-88f8-a4832a920ace\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"
Jul 07 16:19:29.842663 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.842613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.842821 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.842746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-ca\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.842821 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.842771    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-hub\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.842821 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.842789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.842952 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.842865    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d890f2-548b-44ec-8d8a-b63721916baf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.943212 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.943179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.943411 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.943251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-ca\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.943411 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.943279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-hub\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.943411 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.943303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.943411 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.943350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d890f2-548b-44ec-8d8a-b63721916baf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.943411 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.943396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn8mj\" (UniqueName: \"kubernetes.io/projected/e5ddbc95-33bf-4b46-88f8-a4832a920ace-kube-api-access-xn8mj\") pod \"managed-serviceaccount-addon-agent-76685ccbdb-k84r7\" (UID: \"e5ddbc95-33bf-4b46-88f8-a4832a920ace\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"
Jul 07 16:19:29.943670 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.943419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkr9h\" (UniqueName: \"kubernetes.io/projected/51d890f2-548b-44ec-8d8a-b63721916baf-kube-api-access-fkr9h\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.943670 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.943460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5ddbc95-33bf-4b46-88f8-a4832a920ace-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76685ccbdb-k84r7\" (UID: \"e5ddbc95-33bf-4b46-88f8-a4832a920ace\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"
Jul 07 16:19:29.944206 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.944175    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/51d890f2-548b-44ec-8d8a-b63721916baf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.946004 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.945974    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e5ddbc95-33bf-4b46-88f8-a4832a920ace-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76685ccbdb-k84r7\" (UID: \"e5ddbc95-33bf-4b46-88f8-a4832a920ace\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"
Jul 07 16:19:29.946091 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.946021    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.946131 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.946117    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-ca\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.946189 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.946171    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.946224 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.946170    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/51d890f2-548b-44ec-8d8a-b63721916baf-hub\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:29.952324 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.952297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:29.958378 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.958350    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn8mj\" (UniqueName: \"kubernetes.io/projected/e5ddbc95-33bf-4b46-88f8-a4832a920ace-kube-api-access-xn8mj\") pod \"managed-serviceaccount-addon-agent-76685ccbdb-k84r7\" (UID: \"e5ddbc95-33bf-4b46-88f8-a4832a920ace\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"
Jul 07 16:19:29.958481 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:29.958468    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkr9h\" (UniqueName: \"kubernetes.io/projected/51d890f2-548b-44ec-8d8a-b63721916baf-kube-api-access-fkr9h\") pod \"cluster-proxy-proxy-agent-655646d989-8lfxh\" (UID: \"51d890f2-548b-44ec-8d8a-b63721916baf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:30.048590 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:30.048520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"
Jul 07 16:19:30.049667 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:30.049646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:30.096287 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:30.096260    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"
Jul 07 16:19:30.155329 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:30.155070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:30.182176 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:30.182139    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7"]
Jul 07 16:19:30.186672 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:30.186644    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5ddbc95_33bf_4b46_88f8_a4832a920ace.slice/crio-e1bbebffdd82f03150ff766a84623282c096fefc011eb799d98527fd859613dc WatchSource:0}: Error finding container e1bbebffdd82f03150ff766a84623282c096fefc011eb799d98527fd859613dc: Status 404 returned error can't find the container with id e1bbebffdd82f03150ff766a84623282c096fefc011eb799d98527fd859613dc
Jul 07 16:19:30.227774 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:30.227745    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh"]
Jul 07 16:19:30.231127 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:30.231101    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51d890f2_548b_44ec_8d8a_b63721916baf.slice/crio-5484ceb6a8eaf911f2dc585400aef96abbe6575fc8070ccf09d194008f19a9e9 WatchSource:0}: Error finding container 5484ceb6a8eaf911f2dc585400aef96abbe6575fc8070ccf09d194008f19a9e9: Status 404 returned error can't find the container with id 5484ceb6a8eaf911f2dc585400aef96abbe6575fc8070ccf09d194008f19a9e9
Jul 07 16:19:30.253289 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:30.253246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:30.754833 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:30.754792    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7" event={"ID":"e5ddbc95-33bf-4b46-88f8-a4832a920ace","Type":"ContainerStarted","Data":"e1bbebffdd82f03150ff766a84623282c096fefc011eb799d98527fd859613dc"}
Jul 07 16:19:30.755738 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:30.755711    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh" event={"ID":"51d890f2-548b-44ec-8d8a-b63721916baf","Type":"ContainerStarted","Data":"5484ceb6a8eaf911f2dc585400aef96abbe6575fc8070ccf09d194008f19a9e9"}
Jul 07 16:19:32.974141 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:32.974103    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:19:32.974665 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:32.974155    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:19:32.977243 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:32.977221    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 16:19:32.977370 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:32.977223    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 16:19:32.987063 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:32.987042    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6abe5ea-e22a-4433-ad26-2eb34a71290d-metrics-certs\") pod \"network-metrics-daemon-kgchl\" (UID: \"d6abe5ea-e22a-4433-ad26-2eb34a71290d\") " pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:19:32.987154 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:32.987098    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8e12111d-b924-495e-b09b-7c40400657d8-original-pull-secret\") pod \"global-pull-secret-syncer-t8nzc\" (UID: \"8e12111d-b924-495e-b09b-7c40400657d8\") " pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:19:33.075216 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:33.075125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jtz\" (UniqueName: \"kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz\") pod \"network-check-target-z56bk\" (UID: \"a32c936b-17f3-4ceb-abdd-255c91ee33ef\") " pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:19:33.078782 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:33.078744    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52jtz\" (UniqueName: \"kubernetes.io/projected/a32c936b-17f3-4ceb-abdd-255c91ee33ef-kube-api-access-52jtz\") pod \"network-check-target-z56bk\" (UID: \"a32c936b-17f3-4ceb-abdd-255c91ee33ef\") " pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:19:33.092795 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:33.092768    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8nzc"
Jul 07 16:19:33.104315 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:33.104290    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nbnd\""
Jul 07 16:19:33.110076 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:33.110053    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-68hwt\""
Jul 07 16:19:33.112129 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:33.112111    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kgchl"
Jul 07 16:19:33.117859 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:33.117830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:19:33.882195 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:33.882162    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:33.884774 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:33.884750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52347fbd-246a-4419-9cd6-9393930aa41a-metrics-tls\") pod \"dns-default-wft9m\" (UID: \"52347fbd-246a-4419-9cd6-9393930aa41a\") " pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:34.126299 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.126270    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2sv27\""
Jul 07 16:19:34.133079 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.133032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:34.630761 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.630738    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kgchl"]
Jul 07 16:19:34.632716 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:34.632688    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6abe5ea_e22a_4433_ad26_2eb34a71290d.slice/crio-a8528172a3b0a7df74033a59c9cb752cf3ec20fac483f6dc7901a72604acd1e3 WatchSource:0}: Error finding container a8528172a3b0a7df74033a59c9cb752cf3ec20fac483f6dc7901a72604acd1e3: Status 404 returned error can't find the container with id a8528172a3b0a7df74033a59c9cb752cf3ec20fac483f6dc7901a72604acd1e3
Jul 07 16:19:34.771754 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.771723    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh" event={"ID":"51d890f2-548b-44ec-8d8a-b63721916baf","Type":"ContainerStarted","Data":"044e0b8021b9d62ce4e737cb9108939b3e3ad6d7f7482ed32373a6dc9ded20e8"}
Jul 07 16:19:34.771903 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.771774    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh" event={"ID":"51d890f2-548b-44ec-8d8a-b63721916baf","Type":"ContainerStarted","Data":"6453745cedcca0f86c811006ded011e160b5532465ef8ca1276a026385622856"}
Jul 07 16:19:34.772732 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.772708    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kgchl" event={"ID":"d6abe5ea-e22a-4433-ad26-2eb34a71290d","Type":"ContainerStarted","Data":"a8528172a3b0a7df74033a59c9cb752cf3ec20fac483f6dc7901a72604acd1e3"}
Jul 07 16:19:34.774326 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.774301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7" event={"ID":"e5ddbc95-33bf-4b46-88f8-a4832a920ace","Type":"ContainerStarted","Data":"8db889da906bfaef63af8db334ae1413226b2e384bfa71fab932dc972dca4de3"}
Jul 07 16:19:34.791555 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.791514    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76685ccbdb-k84r7" podStartSLOduration=1.545171343 podStartE2EDuration="5.791499022s" totalImagesPullingTime="4.246327679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:34.791111399 +0000 UTC m=+68.145396648" watchObservedRunningTime="2026-07-07 16:19:34.791499022 +0000 UTC m=+68.145784270"
Jul 07 16:19:34.854546 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.854512    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8nzc"]
Jul 07 16:19:34.855490 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.855460    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z56bk"]
Jul 07 16:19:34.857977 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:34.857953    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda32c936b_17f3_4ceb_abdd_255c91ee33ef.slice/crio-921bd331421f89047594725d04ab00deb2713440245f887c70877242f8420cee WatchSource:0}: Error finding container 921bd331421f89047594725d04ab00deb2713440245f887c70877242f8420cee: Status 404 returned error can't find the container with id 921bd331421f89047594725d04ab00deb2713440245f887c70877242f8420cee
Jul 07 16:19:34.858079 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:34.857983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wft9m"]
Jul 07 16:19:34.858806 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:34.858776    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e12111d_b924_495e_b09b_7c40400657d8.slice/crio-d13ad0f7a5ec7e026a0530de8dfcf6e55cc778be750749a50c4b34af4e9366d1 WatchSource:0}: Error finding container d13ad0f7a5ec7e026a0530de8dfcf6e55cc778be750749a50c4b34af4e9366d1: Status 404 returned error can't find the container with id d13ad0f7a5ec7e026a0530de8dfcf6e55cc778be750749a50c4b34af4e9366d1
Jul 07 16:19:34.860431 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:34.860315    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52347fbd_246a_4419_9cd6_9393930aa41a.slice/crio-5e54ac6e5393e9e96b00c34e164f68936dc920ccec1969fd9aee2aaa53c14d2a WatchSource:0}: Error finding container 5e54ac6e5393e9e96b00c34e164f68936dc920ccec1969fd9aee2aaa53c14d2a: Status 404 returned error can't find the container with id 5e54ac6e5393e9e96b00c34e164f68936dc920ccec1969fd9aee2aaa53c14d2a
Jul 07 16:19:35.780387 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:35.780323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wft9m" event={"ID":"52347fbd-246a-4419-9cd6-9393930aa41a","Type":"ContainerStarted","Data":"5e54ac6e5393e9e96b00c34e164f68936dc920ccec1969fd9aee2aaa53c14d2a"}
Jul 07 16:19:35.782513 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:35.782473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8nzc" event={"ID":"8e12111d-b924-495e-b09b-7c40400657d8","Type":"ContainerStarted","Data":"d13ad0f7a5ec7e026a0530de8dfcf6e55cc778be750749a50c4b34af4e9366d1"}
Jul 07 16:19:35.785516 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:35.785468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh" event={"ID":"51d890f2-548b-44ec-8d8a-b63721916baf","Type":"ContainerStarted","Data":"f69edbdd7699e00ee289704d0047e31fb05d64e9dc6dd7b4f91ad0bdc3ad1562"}
Jul 07 16:19:35.787316 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:35.787288    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z56bk" event={"ID":"a32c936b-17f3-4ceb-abdd-255c91ee33ef","Type":"ContainerStarted","Data":"13701671fd771ddd3884d85c515f40cde89f550d1ee094fd94d1f1b43a519f50"}
Jul 07 16:19:35.787439 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:35.787338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z56bk" event={"ID":"a32c936b-17f3-4ceb-abdd-255c91ee33ef","Type":"ContainerStarted","Data":"921bd331421f89047594725d04ab00deb2713440245f887c70877242f8420cee"}
Jul 07 16:19:35.787497 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:35.787451    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:19:35.809218 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:35.808593    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-655646d989-8lfxh" podStartSLOduration=2.5878032920000003 podStartE2EDuration="6.808569618s" totalImagesPullingTime="4.220766326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:35.807342097 +0000 UTC m=+69.161627407" watchObservedRunningTime="2026-07-07 16:19:35.808569618 +0000 UTC m=+69.162854868"
Jul 07 16:19:35.829756 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:35.829161    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z56bk" podStartSLOduration=68.829138802 podStartE2EDuration="1m8.829138802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:35.828105366 +0000 UTC m=+69.182390640" watchObservedRunningTime="2026-07-07 16:19:35.829138802 +0000 UTC m=+69.183424253"
Jul 07 16:19:36.457942 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:36.457671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:36.550565 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:36.550522    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:36.632302 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:36.632265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:36.954313 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:36.954274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:37.798301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:37.798266    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kgchl" event={"ID":"d6abe5ea-e22a-4433-ad26-2eb34a71290d","Type":"ContainerStarted","Data":"14f1b9e739b828f20701a32c0a48be93110f592bfa175a3e627b76ff2fb5b4b0"}
Jul 07 16:19:37.798500 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:37.798329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kgchl" event={"ID":"d6abe5ea-e22a-4433-ad26-2eb34a71290d","Type":"ContainerStarted","Data":"ab8e12d35067755a21377582cf588ac494a92aa2ce8ce1609f2432dab35739cf"}
Jul 07 16:19:37.800274 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:37.800250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wft9m" event={"ID":"52347fbd-246a-4419-9cd6-9393930aa41a","Type":"ContainerStarted","Data":"252095d96a1b1ceaff612ef663d54817c8343f06adde88115f8a0c9586102095"}
Jul 07 16:19:37.800381 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:37.800294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wft9m" event={"ID":"52347fbd-246a-4419-9cd6-9393930aa41a","Type":"ContainerStarted","Data":"0ae096251f366ab3d9d0c322f9140f9a58dee50dce69b9d3990ba771f3332ba0"}
Jul 07 16:19:37.800381 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:37.800327    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:37.827001 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:37.826941    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kgchl" podStartSLOduration=68.499018647 podStartE2EDuration="1m10.826921805s" totalImagesPullingTime="2.327903158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:37.824547453 +0000 UTC m=+71.178832718" watchObservedRunningTime="2026-07-07 16:19:37.826921805 +0000 UTC m=+71.181207055"
Jul 07 16:19:37.845420 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:37.845370    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wft9m" podStartSLOduration=34.73866632 podStartE2EDuration="36.845353829s" totalImagesPullingTime="2.106687509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:37.843925465 +0000 UTC m=+71.198210714" watchObservedRunningTime="2026-07-07 16:19:37.845353829 +0000 UTC m=+71.199639077"
Jul 07 16:19:37.917043 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:37.917006    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:37.919715 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:37.919685    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/10f7d95b-d9e6-426e-b4fc-1ac7290f37d7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vn2v\" (UID: \"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7\") " pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:37.938504 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:37.938469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:38.033859 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:38.033806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:38.162351 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:38.162320    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmpnl\""
Jul 07 16:19:38.170009 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:38.169988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9vn2v"
Jul 07 16:19:39.333239 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:39.333213    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9vn2v"]
Jul 07 16:19:39.339785 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:39.339757    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f7d95b_d9e6_426e_b4fc_1ac7290f37d7.slice/crio-2ff0d954f2f05a2e5c096245962c04f374e37f4516177a8b04e0618a17d12c4f WatchSource:0}: Error finding container 2ff0d954f2f05a2e5c096245962c04f374e37f4516177a8b04e0618a17d12c4f: Status 404 returned error can't find the container with id 2ff0d954f2f05a2e5c096245962c04f374e37f4516177a8b04e0618a17d12c4f
Jul 07 16:19:39.640624 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:39.640591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:39.726220 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:39.726188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:39.811803 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:39.811564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8nzc" event={"ID":"8e12111d-b924-495e-b09b-7c40400657d8","Type":"ContainerStarted","Data":"59c0d04e4c40519e30085c6299e767c364a13633a4cc9fe4ad238eb3cc73b1d8"}
Jul 07 16:19:39.813061 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:39.812990    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vn2v" event={"ID":"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7","Type":"ContainerStarted","Data":"2ff0d954f2f05a2e5c096245962c04f374e37f4516177a8b04e0618a17d12c4f"}
Jul 07 16:19:39.829569 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:39.829517    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t8nzc" podStartSLOduration=68.42716207 podStartE2EDuration="1m12.829499382s" totalImagesPullingTime="4.402337312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:39.829060267 +0000 UTC m=+73.183345515" watchObservedRunningTime="2026-07-07 16:19:39.829499382 +0000 UTC m=+73.183784631"
Jul 07 16:19:43.382134 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:43.382102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:43.470990 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:43.470967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:43.830541 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:43.830462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vn2v" event={"ID":"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7","Type":"ContainerStarted","Data":"2e923392002f7e7ab9e5b0a9405ad43c694cb5f767c6a16043376c0514f2ea62"}
Jul 07 16:19:44.037262 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:44.037232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:44.141931 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:44.141889    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:44.342021 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:44.341976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:44.837082 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:44.836987    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vn2v" event={"ID":"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7","Type":"ContainerStarted","Data":"de100f6d8f3cd88509a4d94023758a1aecdb7f1466cccafe20cce18e837867f8"}
Jul 07 16:19:45.820156 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:45.820098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:45.922385 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:45.922349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:46.722646 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:46.722610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:46.835915 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:46.835872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:46.979992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:46.979923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:47.119617 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.119589    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:47.273079 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.272995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:47.287815 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.287790    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9tvts"]
Jul 07 16:19:47.291347 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.291329    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.296708 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.296680    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 16:19:47.296816 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.296695    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 16:19:47.296816 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.296713    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 16:19:47.297049 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.297011    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4wvwn\""
Jul 07 16:19:47.297118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.297085    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 16:19:47.297453 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.297432    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 16:19:47.297960 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.297937    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 16:19:47.389096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.389066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.389256 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.389113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-tls\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.389256 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.389151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b4b2983-fdef-4012-907a-9c0b17d70647-metrics-client-ca\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.389256 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.389211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b4b2983-fdef-4012-907a-9c0b17d70647-sys\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.389256 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.389237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gknvm\" (UniqueName: \"kubernetes.io/projected/7b4b2983-fdef-4012-907a-9c0b17d70647-kube-api-access-gknvm\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.389462 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.389268    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b4b2983-fdef-4012-907a-9c0b17d70647-root\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.389462 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.389292    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-textfile\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.389462 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.389329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.389462 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.389361    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-wtmp\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.402589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.402557    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:47.489718 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489685    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.489896 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489731    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-wtmp\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.489896 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.489896 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489815    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-tls\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.489896 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b4b2983-fdef-4012-907a-9c0b17d70647-metrics-client-ca\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.490114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b4b2983-fdef-4012-907a-9c0b17d70647-sys\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.490114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489938    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gknvm\" (UniqueName: \"kubernetes.io/projected/7b4b2983-fdef-4012-907a-9c0b17d70647-kube-api-access-gknvm\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.490114 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:47.489948    2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 16:19:47.490114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b4b2983-fdef-4012-907a-9c0b17d70647-root\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.490114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-textfile\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.490114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489994    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b4b2983-fdef-4012-907a-9c0b17d70647-sys\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.490114 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:19:47.490017    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-tls podName:7b4b2983-fdef-4012-907a-9c0b17d70647 nodeName:}" failed. No retries permitted until 2026-07-07 16:19:47.989995284 +0000 UTC m=+81.344280517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-tls") pod "node-exporter-9tvts" (UID: "7b4b2983-fdef-4012-907a-9c0b17d70647") : secret "node-exporter-tls" not found
Jul 07 16:19:47.490114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.489951    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-wtmp\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.490507 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.490300    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7b4b2983-fdef-4012-907a-9c0b17d70647-root\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.490507 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.490322    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-textfile\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.490606 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.490544    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-accelerators-collector-config\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.490606 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.490575    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7b4b2983-fdef-4012-907a-9c0b17d70647-metrics-client-ca\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.492432 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.492411    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.516630 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.516596    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gknvm\" (UniqueName: \"kubernetes.io/projected/7b4b2983-fdef-4012-907a-9c0b17d70647-kube-api-access-gknvm\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.518168 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.518143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:47.618260 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.618229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:47.735092 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.735056    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:47.807375 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.807352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wft9m"
Jul 07 16:19:47.808399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.808371    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:47.850270 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.850230    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vn2v" event={"ID":"10f7d95b-d9e6-426e-b4fc-1ac7290f37d7","Type":"ContainerStarted","Data":"7e1c5b3f19ee1cda4606396f64d10dabedaa7a6486ffdf1762db0616f8f1f0fb"}
Jul 07 16:19:47.878351 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.878248    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9vn2v" podStartSLOduration=35.43645881 podStartE2EDuration="42.878226409s" totalImagesPullingTime="7.441767599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:19:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:47.877447272 +0000 UTC m=+81.231732521" watchObservedRunningTime="2026-07-07 16:19:47.878226409 +0000 UTC m=+81.232511658"
Jul 07 16:19:47.994081 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.994051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-tls\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:47.996490 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:47.996456    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7b4b2983-fdef-4012-907a-9c0b17d70647-node-exporter-tls\") pod \"node-exporter-9tvts\" (UID: \"7b4b2983-fdef-4012-907a-9c0b17d70647\") " pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:48.093350 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:48.093320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:48.198376 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:48.198301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:48.200486 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:48.200468    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9tvts"
Jul 07 16:19:48.212667 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:19:48.212647    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4b2983_fdef_4012_907a_9c0b17d70647.slice/crio-442dcbbfa4e92a0918e36c7b8dbf3137b3fe6d7507629075848c270e92424422 WatchSource:0}: Error finding container 442dcbbfa4e92a0918e36c7b8dbf3137b3fe6d7507629075848c270e92424422: Status 404 returned error can't find the container with id 442dcbbfa4e92a0918e36c7b8dbf3137b3fe6d7507629075848c270e92424422
Jul 07 16:19:48.312854 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:48.312809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:48.414643 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:48.414609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:48.519125 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:48.519035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:48.609260 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:48.609219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:48.800140 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:48.800066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:48.855917 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:48.855879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tvts" event={"ID":"7b4b2983-fdef-4012-907a-9c0b17d70647","Type":"ContainerStarted","Data":"442dcbbfa4e92a0918e36c7b8dbf3137b3fe6d7507629075848c270e92424422"}
Jul 07 16:19:49.776219 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:49.776185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:49.862963 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:49.862929    2563 generic.go:356] "Generic (PLEG): container finished" podID="7b4b2983-fdef-4012-907a-9c0b17d70647" containerID="9d0b1330cf7108139c31c0a5f5467901124bee40921f891b2218f0b3fad54a5a" exitCode=0
Jul 07 16:19:49.863144 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:49.863016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tvts" event={"ID":"7b4b2983-fdef-4012-907a-9c0b17d70647","Type":"ContainerDied","Data":"9d0b1330cf7108139c31c0a5f5467901124bee40921f891b2218f0b3fad54a5a"}
Jul 07 16:19:49.874381 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:49.874358    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:50.165463 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:50.165432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:50.264048 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:50.264008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:50.463676 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:50.463600    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:50.563105 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:50.563061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:50.696831 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:50.696799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:50.868817 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:50.868783    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tvts" event={"ID":"7b4b2983-fdef-4012-907a-9c0b17d70647","Type":"ContainerStarted","Data":"cdb523e78421423225cc0650f2dbae4b4df51e9102c6eace3fb6d64786926d28"}
Jul 07 16:19:50.869298 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:50.868870    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9tvts" event={"ID":"7b4b2983-fdef-4012-907a-9c0b17d70647","Type":"ContainerStarted","Data":"4f579220894bb64e654ab86be90f36a5fe3ac077775c919d8fc2937dafe8670b"}
Jul 07 16:19:50.897101 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:50.897040    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9tvts" podStartSLOduration=2.793789033 podStartE2EDuration="3.897024419s" totalImagesPullingTime="1.041793314s" totalInitContainerRuntime="61.442072ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:19:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:50.896116442 +0000 UTC m=+84.250401692" watchObservedRunningTime="2026-07-07 16:19:50.897024419 +0000 UTC m=+84.251309691"
Jul 07 16:19:51.882199 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:51.882172    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:52.088711 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:52.088681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:52.501298 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:52.501247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:52.601183 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:52.601147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:52.663801 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:52.663768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:53.490993 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:53.490937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:53.668953 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:53.668915    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:53.827076 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:53.826997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:54.826993 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:54.826959    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:54.925626 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:54.925597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:55.143995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:55.143956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:55.251360 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:55.251329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:19:55.348628 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:19:55.348599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:01.984895 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:01.984833    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:02.052607 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:02.052557    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:03.873887 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:03.873829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:03.974612 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:03.974580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:04.181362 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:04.181257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:04.263466 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:04.263434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:05.998275 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:05.998241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:06.095197 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:06.095160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:06.794600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:06.794575    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z56bk"
Jul 07 16:20:13.985340 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:13.985303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:14.086649 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:14.086616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:15.339143 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:15.339111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:15.400462 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:15.400431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:18.577465 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:18.577433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:18.642242 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:18.642168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:19.621014 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:19.620985    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:20.487565 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:20.487533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:20.557474 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:20.557447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:25.091188 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:25.091157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:25.191509 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:25.191477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:35.464980 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:35.464944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:20:35.565208 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:20:35.565178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:21:06.512846 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:21:06.512813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:21:06.938887 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:21:06.938852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:21:17.253236 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:21:17.253203    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:21:17.370373 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:21:17.370343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:21:17.913517 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:21:17.913482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:21:17.973743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:21:17.973713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:21:28.406618 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:21:28.406538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:21:28.506413 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:21:28.506375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:21:28.571005 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:21:28.570978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:07.094532 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:07.094494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:07.194655 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:07.194573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:21.725016 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:21.724985    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:21.789972 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:21.789935    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:23.144353 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:23.144320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:23.204307 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:23.204278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:28.081379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:28.081342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:33.690032 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:33.689998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:33.799849 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:33.799806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:33.875129 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:33.875093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:50.471876 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:50.471782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:22:50.578043 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:22:50.578010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:23:27.077645 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:23:27.077622    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 16:23:37.169264 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:23:37.169219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:23:38.574825 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:23:38.574791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:23:44.768306 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:23:44.768269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:23:59.092595 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:23:59.092560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:00.261364 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:00.261332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:02.923208 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:02.923142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:03.023489 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:03.023453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:03.995534 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:03.995500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:04.102703 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:04.102664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:04.385389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:04.385359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:04.563399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:04.563365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:06.290705 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:06.290670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:06.594208 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:06.594130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:09.559918 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:09.559886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:09.660120 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:09.660081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:11.996626 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:11.996595    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:12.072669 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:12.072641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:14.154994 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.154961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:14.384950 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.384918    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vt6j9"]
Jul 07 16:24:14.387818 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.387801    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vt6j9"
Jul 07 16:24:14.391051 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.391027    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 16:24:14.391199 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.391067    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 16:24:14.392216 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.392196    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-s577p\""
Jul 07 16:24:14.400972 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.400953    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vt6j9"]
Jul 07 16:24:14.517774 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.517682    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwcf6\" (UniqueName: \"kubernetes.io/projected/956bdb0c-63f4-4b11-95a8-c9298676d12b-kube-api-access-jwcf6\") pod \"cert-manager-55b4d954d5-vt6j9\" (UID: \"956bdb0c-63f4-4b11-95a8-c9298676d12b\") " pod="cert-manager/cert-manager-55b4d954d5-vt6j9"
Jul 07 16:24:14.517774 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.517725    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/956bdb0c-63f4-4b11-95a8-c9298676d12b-bound-sa-token\") pod \"cert-manager-55b4d954d5-vt6j9\" (UID: \"956bdb0c-63f4-4b11-95a8-c9298676d12b\") " pod="cert-manager/cert-manager-55b4d954d5-vt6j9"
Jul 07 16:24:14.618708 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.618667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwcf6\" (UniqueName: \"kubernetes.io/projected/956bdb0c-63f4-4b11-95a8-c9298676d12b-kube-api-access-jwcf6\") pod \"cert-manager-55b4d954d5-vt6j9\" (UID: \"956bdb0c-63f4-4b11-95a8-c9298676d12b\") " pod="cert-manager/cert-manager-55b4d954d5-vt6j9"
Jul 07 16:24:14.618708 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.618714    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/956bdb0c-63f4-4b11-95a8-c9298676d12b-bound-sa-token\") pod \"cert-manager-55b4d954d5-vt6j9\" (UID: \"956bdb0c-63f4-4b11-95a8-c9298676d12b\") " pod="cert-manager/cert-manager-55b4d954d5-vt6j9"
Jul 07 16:24:14.628087 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.628057    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/956bdb0c-63f4-4b11-95a8-c9298676d12b-bound-sa-token\") pod \"cert-manager-55b4d954d5-vt6j9\" (UID: \"956bdb0c-63f4-4b11-95a8-c9298676d12b\") " pod="cert-manager/cert-manager-55b4d954d5-vt6j9"
Jul 07 16:24:14.628224 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.628177    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwcf6\" (UniqueName: \"kubernetes.io/projected/956bdb0c-63f4-4b11-95a8-c9298676d12b-kube-api-access-jwcf6\") pod \"cert-manager-55b4d954d5-vt6j9\" (UID: \"956bdb0c-63f4-4b11-95a8-c9298676d12b\") " pod="cert-manager/cert-manager-55b4d954d5-vt6j9"
Jul 07 16:24:14.696111 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.696063    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-vt6j9"
Jul 07 16:24:14.823358 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.823329    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-vt6j9"]
Jul 07 16:24:14.826499 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:24:14.826469    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod956bdb0c_63f4_4b11_95a8_c9298676d12b.slice/crio-24c0bfe7e8b76a897df4f8570f72a0a1fbd78e482186973bd134f9f7b418f7d4 WatchSource:0}: Error finding container 24c0bfe7e8b76a897df4f8570f72a0a1fbd78e482186973bd134f9f7b418f7d4: Status 404 returned error can't find the container with id 24c0bfe7e8b76a897df4f8570f72a0a1fbd78e482186973bd134f9f7b418f7d4
Jul 07 16:24:14.828387 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:14.828369    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:24:15.726379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:15.726341    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vt6j9" event={"ID":"956bdb0c-63f4-4b11-95a8-c9298676d12b","Type":"ContainerStarted","Data":"24c0bfe7e8b76a897df4f8570f72a0a1fbd78e482186973bd134f9f7b418f7d4"}
Jul 07 16:24:16.514010 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:16.513971    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:16.615509 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:16.615440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:18.738871 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:18.738759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-vt6j9" event={"ID":"956bdb0c-63f4-4b11-95a8-c9298676d12b","Type":"ContainerStarted","Data":"9f63de014d3c956447c53586c1aa1738472c8978f66434cc1661a8039f8d6873"}
Jul 07 16:24:18.757491 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:18.757435    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-vt6j9" podStartSLOduration=1.205243054 podStartE2EDuration="4.757419902s" totalImagesPullingTime="3.552176848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:18.755796291 +0000 UTC m=+352.110081542" watchObservedRunningTime="2026-07-07 16:24:18.757419902 +0000 UTC m=+352.111705149"
Jul 07 16:24:21.728967 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:21.728889    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:21.828661 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:21.828623    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:23.374682 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:23.374651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:38.547030 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:38.546989    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:38.653750 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:38.653717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:39.228997 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.228954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:39.467178 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.467147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:39.574699 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.574620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:39.594775 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.594748    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"]
Jul 07 16:24:39.597941 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.597924    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.602268 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.602246    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 16:24:39.602389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.602286    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 16:24:39.602519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.602502    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 16:24:39.602635 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.602541    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 16:24:39.605644 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.605627    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gg9gr\""
Jul 07 16:24:39.618551 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.618527    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"]
Jul 07 16:24:39.691833 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.691803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.692045 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.691864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2f8k\" (UniqueName: \"kubernetes.io/projected/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-kube-api-access-m2f8k\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.692045 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.691917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.692045 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.691950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-tmp\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.692045 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.691988    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-manifests\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.742779 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.742752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:39.792935 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.792911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-tmp\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.792935 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.792941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-manifests\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.793124 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.792975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.793124 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.793016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2f8k\" (UniqueName: \"kubernetes.io/projected/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-kube-api-access-m2f8k\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.793124 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.793057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.793327 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.793306    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-manifests\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.795306 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.795276    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-tmp\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.795388 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.795374    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.795388 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.795380    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.802818 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.802800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2f8k\" (UniqueName: \"kubernetes.io/projected/70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0-kube-api-access-m2f8k\") pod \"opendatahub-operator-controller-manager-6f64778974-5nz45\" (UID: \"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0\") " pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.846250 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.846164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:39.907461 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.907429    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:39.995473 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:39.995424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:40.041113 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:40.041029    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"]
Jul 07 16:24:40.043404 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:24:40.043382    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e6f2ea_2d9a_46cc_8a04_a51f4d5df9e0.slice/crio-ad42c8eace41e385e5292c0dec2fb95fae096841ba5a2f22dceacdf935b099c1 WatchSource:0}: Error finding container ad42c8eace41e385e5292c0dec2fb95fae096841ba5a2f22dceacdf935b099c1: Status 404 returned error can't find the container with id ad42c8eace41e385e5292c0dec2fb95fae096841ba5a2f22dceacdf935b099c1
Jul 07 16:24:40.077024 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:40.076974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:40.178952 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:40.178905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:40.285130 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:40.285098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:40.819606 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:40.819568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45" event={"ID":"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0","Type":"ContainerStarted","Data":"ad42c8eace41e385e5292c0dec2fb95fae096841ba5a2f22dceacdf935b099c1"}
Jul 07 16:24:43.112708 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:43.112665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:43.833293 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:43.833258    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45" event={"ID":"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0","Type":"ContainerStarted","Data":"c62582230d2e0ac88ce2187fb2f8e6610c285293956ff142b5e02508f2beb08f"}
Jul 07 16:24:44.837877 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:44.837825    2563 generic.go:356] "Generic (PLEG): container finished" podID="70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0" containerID="c62582230d2e0ac88ce2187fb2f8e6610c285293956ff142b5e02508f2beb08f" exitCode=0
Jul 07 16:24:44.838265 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:44.837877    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45" event={"ID":"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0","Type":"ContainerDied","Data":"c62582230d2e0ac88ce2187fb2f8e6610c285293956ff142b5e02508f2beb08f"}
Jul 07 16:24:45.844449 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:45.844408    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45" event={"ID":"70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0","Type":"ContainerStarted","Data":"59cf7c0e0a2b4ddfa34236e97afb9c2a23ee3b698ff6d020ef1211f0daa2d256"}
Jul 07 16:24:45.844924 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:45.844561    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:45.875273 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:45.875221    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45" podStartSLOduration=2.259391902 podStartE2EDuration="6.875205634s" totalImagesPullingTime="3.558276463s" totalInitContainerRuntime="1.057537269s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:24:45.874195857 +0000 UTC m=+379.228481105" watchObservedRunningTime="2026-07-07 16:24:45.875205634 +0000 UTC m=+379.229490882"
Jul 07 16:24:53.948907 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:53.948863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:54.056157 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:54.056122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:56.849415 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:56.849387    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f64778974-5nz45"
Jul 07 16:24:58.891120 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:58.891086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:59.023530 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.023495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:59.634607 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.634577    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:59.700020 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.699984    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"]
Jul 07 16:24:59.704681 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.704661    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:24:59.709850 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.709812    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 16:24:59.709987 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.709969    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6xdvb\""
Jul 07 16:24:59.711159 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.711132    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 16:24:59.711159 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.711133    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 16:24:59.714072 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.714054    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 16:24:59.718158 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.718136    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"]
Jul 07 16:24:59.837113 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.837076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zn62\" (UniqueName: \"kubernetes.io/projected/201979d1-95ba-41bc-9ec4-a93886cce720-kube-api-access-4zn62\") pod \"kube-auth-proxy-7cbbdb79bb-7txjg\" (UID: \"201979d1-95ba-41bc-9ec4-a93886cce720\") " pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:24:59.837314 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.837120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201979d1-95ba-41bc-9ec4-a93886cce720-tmp\") pod \"kube-auth-proxy-7cbbdb79bb-7txjg\" (UID: \"201979d1-95ba-41bc-9ec4-a93886cce720\") " pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:24:59.837314 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.837144    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/201979d1-95ba-41bc-9ec4-a93886cce720-tls-certs\") pod \"kube-auth-proxy-7cbbdb79bb-7txjg\" (UID: \"201979d1-95ba-41bc-9ec4-a93886cce720\") " pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:24:59.912426 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.912348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:24:59.938441 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.938411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zn62\" (UniqueName: \"kubernetes.io/projected/201979d1-95ba-41bc-9ec4-a93886cce720-kube-api-access-4zn62\") pod \"kube-auth-proxy-7cbbdb79bb-7txjg\" (UID: \"201979d1-95ba-41bc-9ec4-a93886cce720\") " pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:24:59.938560 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.938456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201979d1-95ba-41bc-9ec4-a93886cce720-tmp\") pod \"kube-auth-proxy-7cbbdb79bb-7txjg\" (UID: \"201979d1-95ba-41bc-9ec4-a93886cce720\") " pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:24:59.938560 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.938479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/201979d1-95ba-41bc-9ec4-a93886cce720-tls-certs\") pod \"kube-auth-proxy-7cbbdb79bb-7txjg\" (UID: \"201979d1-95ba-41bc-9ec4-a93886cce720\") " pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:24:59.940776 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.940750    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/201979d1-95ba-41bc-9ec4-a93886cce720-tmp\") pod \"kube-auth-proxy-7cbbdb79bb-7txjg\" (UID: \"201979d1-95ba-41bc-9ec4-a93886cce720\") " pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:24:59.941118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.941095    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/201979d1-95ba-41bc-9ec4-a93886cce720-tls-certs\") pod \"kube-auth-proxy-7cbbdb79bb-7txjg\" (UID: \"201979d1-95ba-41bc-9ec4-a93886cce720\") " pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:24:59.951728 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:24:59.951698    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zn62\" (UniqueName: \"kubernetes.io/projected/201979d1-95ba-41bc-9ec4-a93886cce720-kube-api-access-4zn62\") pod \"kube-auth-proxy-7cbbdb79bb-7txjg\" (UID: \"201979d1-95ba-41bc-9ec4-a93886cce720\") " pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:25:00.013436 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.013408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"
Jul 07 16:25:00.014584 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.014561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:00.112980 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.112951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:00.154793 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.154770    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg"]
Jul 07 16:25:00.158568 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:25:00.158539    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod201979d1_95ba_41bc_9ec4_a93886cce720.slice/crio-9f1e8f8402c86290853165b158a3b727a7ee04c5386aaa32b5158aa4b9523d0b WatchSource:0}: Error finding container 9f1e8f8402c86290853165b158a3b727a7ee04c5386aaa32b5158aa4b9523d0b: Status 404 returned error can't find the container with id 9f1e8f8402c86290853165b158a3b727a7ee04c5386aaa32b5158aa4b9523d0b
Jul 07 16:25:00.321662 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.321577    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:00.738479 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.738447    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tfcgw"]
Jul 07 16:25:00.742429 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.742181    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw"
Jul 07 16:25:00.742689 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.742652    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:00.745144 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.745122    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 16:25:00.746635 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.746617    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-fmfm4\""
Jul 07 16:25:00.764758 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.764727    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tfcgw"]
Jul 07 16:25:00.845784 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.845748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsbmd\" (UniqueName: \"kubernetes.io/projected/9df4643c-39c8-42cc-8d3b-2501657cfc3e-kube-api-access-bsbmd\") pod \"model-serving-api-54d89bd5fc-tfcgw\" (UID: \"9df4643c-39c8-42cc-8d3b-2501657cfc3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw"
Jul 07 16:25:00.845979 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.845807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df4643c-39c8-42cc-8d3b-2501657cfc3e-tls-certs\") pod \"model-serving-api-54d89bd5fc-tfcgw\" (UID: \"9df4643c-39c8-42cc-8d3b-2501657cfc3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw"
Jul 07 16:25:00.863568 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.863532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:00.897108 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.897070    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg" event={"ID":"201979d1-95ba-41bc-9ec4-a93886cce720","Type":"ContainerStarted","Data":"9f1e8f8402c86290853165b158a3b727a7ee04c5386aaa32b5158aa4b9523d0b"}
Jul 07 16:25:00.947312 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.947260    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df4643c-39c8-42cc-8d3b-2501657cfc3e-tls-certs\") pod \"model-serving-api-54d89bd5fc-tfcgw\" (UID: \"9df4643c-39c8-42cc-8d3b-2501657cfc3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw"
Jul 07 16:25:00.947761 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.947384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsbmd\" (UniqueName: \"kubernetes.io/projected/9df4643c-39c8-42cc-8d3b-2501657cfc3e-kube-api-access-bsbmd\") pod \"model-serving-api-54d89bd5fc-tfcgw\" (UID: \"9df4643c-39c8-42cc-8d3b-2501657cfc3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw"
Jul 07 16:25:00.957615 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.957579    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9df4643c-39c8-42cc-8d3b-2501657cfc3e-tls-certs\") pod \"model-serving-api-54d89bd5fc-tfcgw\" (UID: \"9df4643c-39c8-42cc-8d3b-2501657cfc3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw"
Jul 07 16:25:00.962650 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:00.962624    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsbmd\" (UniqueName: \"kubernetes.io/projected/9df4643c-39c8-42cc-8d3b-2501657cfc3e-kube-api-access-bsbmd\") pod \"model-serving-api-54d89bd5fc-tfcgw\" (UID: \"9df4643c-39c8-42cc-8d3b-2501657cfc3e\") " pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw"
Jul 07 16:25:01.054092 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:01.054007    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw"
Jul 07 16:25:01.131123 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:01.131046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:01.240580 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:01.240469    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tfcgw"]
Jul 07 16:25:01.245437 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:25:01.245397    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df4643c_39c8_42cc_8d3b_2501657cfc3e.slice/crio-1d1905a7957aed9a5e7c4ac97c008f451e542c1103bf292c6bc50aa415cf697e WatchSource:0}: Error finding container 1d1905a7957aed9a5e7c4ac97c008f451e542c1103bf292c6bc50aa415cf697e: Status 404 returned error can't find the container with id 1d1905a7957aed9a5e7c4ac97c008f451e542c1103bf292c6bc50aa415cf697e
Jul 07 16:25:01.276339 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:01.276310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:01.902063 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:01.902023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw" event={"ID":"9df4643c-39c8-42cc-8d3b-2501657cfc3e","Type":"ContainerStarted","Data":"1d1905a7957aed9a5e7c4ac97c008f451e542c1103bf292c6bc50aa415cf697e"}
Jul 07 16:25:02.447917 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:02.447876    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:03.911639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:03.911606    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg" event={"ID":"201979d1-95ba-41bc-9ec4-a93886cce720","Type":"ContainerStarted","Data":"443839ff2aa8242a420c3b94dccd7d491217f8be05f83ba4aa4b02bde895cbf9"}
Jul 07 16:25:03.913118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:03.913094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw" event={"ID":"9df4643c-39c8-42cc-8d3b-2501657cfc3e","Type":"ContainerStarted","Data":"d786fafa53844595f4ad353b872983bfb7409fc854d6c856f3fe7c9eab3f8350"}
Jul 07 16:25:03.913262 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:03.913232    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw"
Jul 07 16:25:03.929755 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:03.929710    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cbbdb79bb-7txjg" podStartSLOduration=1.322704661 podStartE2EDuration="4.929696729s" totalImagesPullingTime="3.606992068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:25:03.927872164 +0000 UTC m=+397.282157412" watchObservedRunningTime="2026-07-07 16:25:03.929696729 +0000 UTC m=+397.283981977"
Jul 07 16:25:03.949150 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:03.949085    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw" podStartSLOduration=1.429383336 podStartE2EDuration="3.949065901s" totalImagesPullingTime="2.519682565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:25:03.947339119 +0000 UTC m=+397.301624368" watchObservedRunningTime="2026-07-07 16:25:03.949065901 +0000 UTC m=+397.303351148"
Jul 07 16:25:05.157454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.157420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:05.256803 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.256764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:05.475176 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.475090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:05.512615 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.512585    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"]
Jul 07 16:25:05.516032 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.516016    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.528639 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.528620    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 16:25:05.528773 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.528620    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n5l44\""
Jul 07 16:25:05.536502 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.536475    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"]
Jul 07 16:25:05.586282 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.586249    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.586443 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.586294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f842bd1b-ec8f-4baf-b042-90917b33dea7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.586443 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.586320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.586443 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.586364    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.586443 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.586421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.586625 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.586444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.586625 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.586469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.586625 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.586491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6l66\" (UniqueName: \"kubernetes.io/projected/f842bd1b-ec8f-4baf-b042-90917b33dea7-kube-api-access-k6l66\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.586625 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.586521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.668019 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.667985    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:05.687074 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687197 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f842bd1b-ec8f-4baf-b042-90917b33dea7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687197 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687197 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687197 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687197 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687425 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687218    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687425 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6l66\" (UniqueName: \"kubernetes.io/projected/f842bd1b-ec8f-4baf-b042-90917b33dea7-kube-api-access-k6l66\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687425 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687418    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687611 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687521    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687611 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687553    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687687 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687614    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.687876 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.687858    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f842bd1b-ec8f-4baf-b042-90917b33dea7-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.688113 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.688092    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.689685 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.689657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.690176 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.690158    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.696096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.696074    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6l66\" (UniqueName: \"kubernetes.io/projected/f842bd1b-ec8f-4baf-b042-90917b33dea7-kube-api-access-k6l66\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.696519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.696502    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f842bd1b-ec8f-4baf-b042-90917b33dea7-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf46mzj2\" (UID: \"f842bd1b-ec8f-4baf-b042-90917b33dea7\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:05.793537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.793453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:05.826134 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:05.826101    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:06.036120 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:06.036087    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"]
Jul 07 16:25:06.039022 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:25:06.038991    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf842bd1b_ec8f_4baf_b042_90917b33dea7.slice/crio-353fe4f7ea11ce105460784424771e0beb85fd6c1b7c4cb8905938da5a512069 WatchSource:0}: Error finding container 353fe4f7ea11ce105460784424771e0beb85fd6c1b7c4cb8905938da5a512069: Status 404 returned error can't find the container with id 353fe4f7ea11ce105460784424771e0beb85fd6c1b7c4cb8905938da5a512069
Jul 07 16:25:06.927535 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:06.927497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2" event={"ID":"f842bd1b-ec8f-4baf-b042-90917b33dea7","Type":"ContainerStarted","Data":"353fe4f7ea11ce105460784424771e0beb85fd6c1b7c4cb8905938da5a512069"}
Jul 07 16:25:08.166635 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.166601    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"]
Jul 07 16:25:08.173458 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.173433    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.177945 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.177798    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 16:25:08.177945 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.177891    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 16:25:08.177945 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.177906    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 16:25:08.178190 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.177965    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 16:25:08.178190 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.177799    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lrgp4\""
Jul 07 16:25:08.178190 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.177892    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 16:25:08.182185 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.181973    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"]
Jul 07 16:25:08.311646 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.311614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d16934bb-942f-49a8-96a4-0bcabf033059-manager-config\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.311646 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.311646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d16934bb-942f-49a8-96a4-0bcabf033059-cert\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.311928 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.311668    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrgxr\" (UniqueName: \"kubernetes.io/projected/d16934bb-942f-49a8-96a4-0bcabf033059-kube-api-access-nrgxr\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.311928 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.311807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d16934bb-942f-49a8-96a4-0bcabf033059-metrics-cert\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.413098 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.413057    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d16934bb-942f-49a8-96a4-0bcabf033059-metrics-cert\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.413286 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.413141    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d16934bb-942f-49a8-96a4-0bcabf033059-manager-config\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.413286 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.413163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d16934bb-942f-49a8-96a4-0bcabf033059-cert\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.413286 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.413198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrgxr\" (UniqueName: \"kubernetes.io/projected/d16934bb-942f-49a8-96a4-0bcabf033059-kube-api-access-nrgxr\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.413981 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.413958    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d16934bb-942f-49a8-96a4-0bcabf033059-manager-config\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.415995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.415965    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d16934bb-942f-49a8-96a4-0bcabf033059-metrics-cert\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.416112 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.416091    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d16934bb-942f-49a8-96a4-0bcabf033059-cert\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.440105 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.440038    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrgxr\" (UniqueName: \"kubernetes.io/projected/d16934bb-942f-49a8-96a4-0bcabf033059-kube-api-access-nrgxr\") pod \"lws-controller-manager-5cb66b9dcc-zzw9n\" (UID: \"d16934bb-942f-49a8-96a4-0bcabf033059\") " pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.485086 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.485053    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:08.690808 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.690739    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:25:08.690916 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.690821    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:25:08.690916 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.690897    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:25:08.770807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.770783    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"]
Jul 07 16:25:08.773335 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:25:08.773306    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16934bb_942f_49a8_96a4_0bcabf033059.slice/crio-4270a05cb4f4552ab59de8202366f446138c510f903d30a73eeb07302cc5b9e2 WatchSource:0}: Error finding container 4270a05cb4f4552ab59de8202366f446138c510f903d30a73eeb07302cc5b9e2: Status 404 returned error can't find the container with id 4270a05cb4f4552ab59de8202366f446138c510f903d30a73eeb07302cc5b9e2
Jul 07 16:25:08.938065 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.938027    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2" event={"ID":"f842bd1b-ec8f-4baf-b042-90917b33dea7","Type":"ContainerStarted","Data":"aadbe0dcc2d30d5d6b80a02e45cb5e36ff39e9a1db79c8b29bd99cacf0c079b6"}
Jul 07 16:25:08.939187 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.939164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n" event={"ID":"d16934bb-942f-49a8-96a4-0bcabf033059","Type":"ContainerStarted","Data":"4270a05cb4f4552ab59de8202366f446138c510f903d30a73eeb07302cc5b9e2"}
Jul 07 16:25:08.983899 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:08.983774    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2" podStartSLOduration=1.3342968769999999 podStartE2EDuration="3.983754557s" totalImagesPullingTime="2.64945768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:25:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:25:08.982461083 +0000 UTC m=+402.336746331" watchObservedRunningTime="2026-07-07 16:25:08.983754557 +0000 UTC m=+402.338039807"
Jul 07 16:25:09.827190 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:09.827114    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:09.832895 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:09.832864    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:09.944126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:09.944086    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:09.945347 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:09.945326    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf46mzj2"
Jul 07 16:25:10.419023 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:10.418978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:10.560222 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:10.560181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:10.662421 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:10.662372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:10.796476 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:10.796367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:11.751745 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:11.751712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:11.865130 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:11.865104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:11.955359 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:11.955328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n" event={"ID":"d16934bb-942f-49a8-96a4-0bcabf033059","Type":"ContainerStarted","Data":"20fac17ace11486b9870a85eefd41ae97cf58b5c22b920e73805b853ef51cc84"}
Jul 07 16:25:11.955529 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:11.955415    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:11.993376 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:11.993330    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n" podStartSLOduration=1.61108984 podStartE2EDuration="3.993314651s" totalImagesPullingTime="2.382224811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:25:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:25:11.990970064 +0000 UTC m=+405.345255315" watchObservedRunningTime="2026-07-07 16:25:11.993314651 +0000 UTC m=+405.347599898"
Jul 07 16:25:11.995051 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:11.995028    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:14.922105 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:14.922078    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tfcgw"
Jul 07 16:25:22.961409 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:22.961378    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5cb66b9dcc-zzw9n"
Jul 07 16:25:34.532855 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:34.532803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:25:34.590268 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:25:34.590238    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:00.323123 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:00.323038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:00.423065 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:00.423034    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:00.531624 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:00.531592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:01.257335 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:01.257303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:01.459608 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:01.459576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:29.517108 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:29.517074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:32.931055 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:32.931025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:33.715496 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:33.715467    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:37.037577 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:37.037539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:37.328792 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:37.328708    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:38.949392 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:38.949359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:40.134337 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:40.134300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:41.384895 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:41.384851    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:44.569026 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:44.568988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:46.136901 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:46.136871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:46.237550 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:46.237518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:50.117041 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:50.117001    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:50.175095 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:50.175060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:50.530315 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:50.530229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:50.627196 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:50.627163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:53.524803 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:53.524767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:53.644458 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:53.644428    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:54.026309 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:54.026280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:54.342164 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:54.342082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:58.336570 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:58.336535    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:26:58.436968 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:26:58.436935    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:05.073488 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:05.073455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:05.181869 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:05.181814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:08.778466 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:08.778430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:08.839217 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:08.839188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:08.981490 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:08.981457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:09.045492 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:09.045401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:12.573386 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:12.573354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:12.674329 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:12.674288    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:17.207293 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:17.207253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:17.304880 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:17.304824    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:25.107116 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:25.107045    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:33.326777 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:33.326744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:33.703321 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:33.703266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:46.667247 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:46.667219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:46.768509 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:46.768475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:48.457709 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:48.457678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:48.556026 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:48.555987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:48.618028 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:48.617995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:49.264458 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.264416    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-p8sl8"]
Jul 07 16:27:49.267611 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.267587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p8sl8"
Jul 07 16:27:49.270474 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.270454    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 16:27:49.271671 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.271655    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rqp4l\""
Jul 07 16:27:49.271730 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.271707    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 16:27:49.275997 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.275973    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-p8sl8"]
Jul 07 16:27:49.307426 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.307390    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:49.381693 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.381667    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj5k4\" (UniqueName: \"kubernetes.io/projected/1f771884-97b4-4c4d-84bd-414cac9d36ee-kube-api-access-kj5k4\") pod \"authorino-58cd955675-p8sl8\" (UID: \"1f771884-97b4-4c4d-84bd-414cac9d36ee\") " pod="kuadrant-system/authorino-58cd955675-p8sl8"
Jul 07 16:27:49.402043 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.402011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:27:49.464967 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.464932    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcd5j"]
Jul 07 16:27:49.467981 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.467963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hcd5j"
Jul 07 16:27:49.475669 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.475642    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcd5j"]
Jul 07 16:27:49.482819 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.482794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj5k4\" (UniqueName: \"kubernetes.io/projected/1f771884-97b4-4c4d-84bd-414cac9d36ee-kube-api-access-kj5k4\") pod \"authorino-58cd955675-p8sl8\" (UID: \"1f771884-97b4-4c4d-84bd-414cac9d36ee\") " pod="kuadrant-system/authorino-58cd955675-p8sl8"
Jul 07 16:27:49.492813 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.492791    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj5k4\" (UniqueName: \"kubernetes.io/projected/1f771884-97b4-4c4d-84bd-414cac9d36ee-kube-api-access-kj5k4\") pod \"authorino-58cd955675-p8sl8\" (UID: \"1f771884-97b4-4c4d-84bd-414cac9d36ee\") " pod="kuadrant-system/authorino-58cd955675-p8sl8"
Jul 07 16:27:49.577681 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.577596    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p8sl8"
Jul 07 16:27:49.583642 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.583618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfvs7\" (UniqueName: \"kubernetes.io/projected/769ce3bf-5073-4db7-9f28-fc242fcee820-kube-api-access-nfvs7\") pod \"authorino-75d556bd77-hcd5j\" (UID: \"769ce3bf-5073-4db7-9f28-fc242fcee820\") " pod="kuadrant-system/authorino-75d556bd77-hcd5j"
Jul 07 16:27:49.684400 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.684373    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfvs7\" (UniqueName: \"kubernetes.io/projected/769ce3bf-5073-4db7-9f28-fc242fcee820-kube-api-access-nfvs7\") pod \"authorino-75d556bd77-hcd5j\" (UID: \"769ce3bf-5073-4db7-9f28-fc242fcee820\") " pod="kuadrant-system/authorino-75d556bd77-hcd5j"
Jul 07 16:27:49.696399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.696375    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfvs7\" (UniqueName: \"kubernetes.io/projected/769ce3bf-5073-4db7-9f28-fc242fcee820-kube-api-access-nfvs7\") pod \"authorino-75d556bd77-hcd5j\" (UID: \"769ce3bf-5073-4db7-9f28-fc242fcee820\") " pod="kuadrant-system/authorino-75d556bd77-hcd5j"
Jul 07 16:27:49.702700 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.702659    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-p8sl8"]
Jul 07 16:27:49.705001 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:27:49.704978    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f771884_97b4_4c4d_84bd_414cac9d36ee.slice/crio-28775a3e2ff63252b77cafdc3e64beff56144194b5d86fa93735eb02a00b4b25 WatchSource:0}: Error finding container 28775a3e2ff63252b77cafdc3e64beff56144194b5d86fa93735eb02a00b4b25: Status 404 returned error can't find the container with id 28775a3e2ff63252b77cafdc3e64beff56144194b5d86fa93735eb02a00b4b25
Jul 07 16:27:49.777070 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.777044    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hcd5j"
Jul 07 16:27:49.901988 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:49.901965    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcd5j"]
Jul 07 16:27:49.904083 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:27:49.904057    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod769ce3bf_5073_4db7_9f28_fc242fcee820.slice/crio-2f7bec6120d5080478a2a62aba6fbcd302bd8ea71972cedfdc7e15b5faefbac1 WatchSource:0}: Error finding container 2f7bec6120d5080478a2a62aba6fbcd302bd8ea71972cedfdc7e15b5faefbac1: Status 404 returned error can't find the container with id 2f7bec6120d5080478a2a62aba6fbcd302bd8ea71972cedfdc7e15b5faefbac1
Jul 07 16:27:50.570997 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:50.570921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hcd5j" event={"ID":"769ce3bf-5073-4db7-9f28-fc242fcee820","Type":"ContainerStarted","Data":"2f7bec6120d5080478a2a62aba6fbcd302bd8ea71972cedfdc7e15b5faefbac1"}
Jul 07 16:27:50.573665 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:50.573584    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p8sl8" event={"ID":"1f771884-97b4-4c4d-84bd-414cac9d36ee","Type":"ContainerStarted","Data":"28775a3e2ff63252b77cafdc3e64beff56144194b5d86fa93735eb02a00b4b25"}
Jul 07 16:27:53.588989 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:53.588885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p8sl8" event={"ID":"1f771884-97b4-4c4d-84bd-414cac9d36ee","Type":"ContainerStarted","Data":"51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257"}
Jul 07 16:27:53.590352 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:53.590330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hcd5j" event={"ID":"769ce3bf-5073-4db7-9f28-fc242fcee820","Type":"ContainerStarted","Data":"daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66"}
Jul 07 16:27:53.604556 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:53.604515    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-p8sl8" podStartSLOduration=1.099577491 podStartE2EDuration="4.604502219s" totalImagesPullingTime="3.504924728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:53.603973778 +0000 UTC m=+566.958259047" watchObservedRunningTime="2026-07-07 16:27:53.604502219 +0000 UTC m=+566.958787500"
Jul 07 16:27:53.619352 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:53.619306    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hcd5j" podStartSLOduration=1.30304598 podStartE2EDuration="4.619292181s" totalImagesPullingTime="3.316246201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:27:53.619148875 +0000 UTC m=+566.973434124" watchObservedRunningTime="2026-07-07 16:27:53.619292181 +0000 UTC m=+566.973577428"
Jul 07 16:27:53.644123 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:53.644099    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-p8sl8"]
Jul 07 16:27:55.597880 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:55.597825    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-p8sl8" podUID="1f771884-97b4-4c4d-84bd-414cac9d36ee" containerName="authorino" containerID="cri-o://51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257" gracePeriod=30
Jul 07 16:27:55.843027 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:55.842999    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p8sl8"
Jul 07 16:27:55.934431 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:55.934401    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kj5k4\" (UniqueName: \"kubernetes.io/projected/1f771884-97b4-4c4d-84bd-414cac9d36ee-kube-api-access-kj5k4\") pod \"1f771884-97b4-4c4d-84bd-414cac9d36ee\" (UID: \"1f771884-97b4-4c4d-84bd-414cac9d36ee\") "
Jul 07 16:27:55.936585 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:55.936559    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f771884-97b4-4c4d-84bd-414cac9d36ee-kube-api-access-kj5k4" (OuterVolumeSpecName: "kube-api-access-kj5k4") pod "1f771884-97b4-4c4d-84bd-414cac9d36ee" (UID: "1f771884-97b4-4c4d-84bd-414cac9d36ee"). InnerVolumeSpecName "kube-api-access-kj5k4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:27:56.035873 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:56.035825    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kj5k4\" (UniqueName: \"kubernetes.io/projected/1f771884-97b4-4c4d-84bd-414cac9d36ee-kube-api-access-kj5k4\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:27:56.603057 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:56.603023    2563 generic.go:356] "Generic (PLEG): container finished" podID="1f771884-97b4-4c4d-84bd-414cac9d36ee" containerID="51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257" exitCode=0
Jul 07 16:27:56.603514 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:56.603062    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-p8sl8"
Jul 07 16:27:56.603514 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:56.603114    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p8sl8" event={"ID":"1f771884-97b4-4c4d-84bd-414cac9d36ee","Type":"ContainerDied","Data":"51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257"}
Jul 07 16:27:56.603514 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:56.603151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-p8sl8" event={"ID":"1f771884-97b4-4c4d-84bd-414cac9d36ee","Type":"ContainerDied","Data":"28775a3e2ff63252b77cafdc3e64beff56144194b5d86fa93735eb02a00b4b25"}
Jul 07 16:27:56.603514 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:56.603168    2563 scope.go:117] "RemoveContainer" containerID="51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257"
Jul 07 16:27:56.612006 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:56.611991    2563 scope.go:117] "RemoveContainer" containerID="51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257"
Jul 07 16:27:56.612247 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:27:56.612226    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257\": container with ID starting with 51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257 not found: ID does not exist" containerID="51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257"
Jul 07 16:27:56.612301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:56.612255    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257"} err="failed to get container status \"51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257\": rpc error: code = NotFound desc = could not find container \"51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257\": container with ID starting with 51c0e2e57ce10245ffafd5c2d60007be184a0acb28eb67ba5dd2328e1c400257 not found: ID does not exist"
Jul 07 16:27:56.623912 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:56.623888    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-p8sl8"]
Jul 07 16:27:56.627341 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:56.627324    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-p8sl8"]
Jul 07 16:27:57.385723 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:27:57.385694    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f771884-97b4-4c4d-84bd-414cac9d36ee" path="/var/lib/kubelet/pods/1f771884-97b4-4c4d-84bd-414cac9d36ee/volumes"
Jul 07 16:28:06.936899 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:06.936864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:28:19.653976 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:19.653939    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:28:19.857110 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:19.857075    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npn98"]
Jul 07 16:28:19.857399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:19.857385    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f771884-97b4-4c4d-84bd-414cac9d36ee" containerName="authorino"
Jul 07 16:28:19.857441 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:19.857402    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f771884-97b4-4c4d-84bd-414cac9d36ee" containerName="authorino"
Jul 07 16:28:19.857475 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:19.857454    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f771884-97b4-4c4d-84bd-414cac9d36ee" containerName="authorino"
Jul 07 16:28:19.861743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:19.861719    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-npn98"
Jul 07 16:28:19.869216 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:19.869187    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npn98"]
Jul 07 16:28:19.884281 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:19.884240    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:28:19.914467 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:19.914403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpn8b\" (UniqueName: \"kubernetes.io/projected/d57c30ce-29a5-456d-82ce-9ccdd0148d4e-kube-api-access-fpn8b\") pod \"authorino-5d4b67c446-npn98\" (UID: \"d57c30ce-29a5-456d-82ce-9ccdd0148d4e\") " pod="kuadrant-system/authorino-5d4b67c446-npn98"
Jul 07 16:28:20.014914 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.014880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpn8b\" (UniqueName: \"kubernetes.io/projected/d57c30ce-29a5-456d-82ce-9ccdd0148d4e-kube-api-access-fpn8b\") pod \"authorino-5d4b67c446-npn98\" (UID: \"d57c30ce-29a5-456d-82ce-9ccdd0148d4e\") " pod="kuadrant-system/authorino-5d4b67c446-npn98"
Jul 07 16:28:20.024181 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.024153    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpn8b\" (UniqueName: \"kubernetes.io/projected/d57c30ce-29a5-456d-82ce-9ccdd0148d4e-kube-api-access-fpn8b\") pod \"authorino-5d4b67c446-npn98\" (UID: \"d57c30ce-29a5-456d-82ce-9ccdd0148d4e\") " pod="kuadrant-system/authorino-5d4b67c446-npn98"
Jul 07 16:28:20.074129 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.074095    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npn98"]
Jul 07 16:28:20.074329 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.074317    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-npn98"
Jul 07 16:28:20.115823 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.115783    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77669df8cb-wvh26"]
Jul 07 16:28:20.119444 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.119426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77669df8cb-wvh26"
Jul 07 16:28:20.122125 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.122106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 16:28:20.132697 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.132672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77669df8cb-wvh26"]
Jul 07 16:28:20.206781 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.206651    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npn98"]
Jul 07 16:28:20.209501 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:28:20.209459    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd57c30ce_29a5_456d_82ce_9ccdd0148d4e.slice/crio-21e482a7b41f05d0ae8e9b2b9946b3a769b7765204555b6d68fd3f8f55c9fb2c WatchSource:0}: Error finding container 21e482a7b41f05d0ae8e9b2b9946b3a769b7765204555b6d68fd3f8f55c9fb2c: Status 404 returned error can't find the container with id 21e482a7b41f05d0ae8e9b2b9946b3a769b7765204555b6d68fd3f8f55c9fb2c
Jul 07 16:28:20.216785 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.216764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99ca7431-0efc-48e6-8402-27cd11fe971d-tls-cert\") pod \"authorino-77669df8cb-wvh26\" (UID: \"99ca7431-0efc-48e6-8402-27cd11fe971d\") " pod="kuadrant-system/authorino-77669df8cb-wvh26"
Jul 07 16:28:20.216937 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.216797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r66qf\" (UniqueName: \"kubernetes.io/projected/99ca7431-0efc-48e6-8402-27cd11fe971d-kube-api-access-r66qf\") pod \"authorino-77669df8cb-wvh26\" (UID: \"99ca7431-0efc-48e6-8402-27cd11fe971d\") " pod="kuadrant-system/authorino-77669df8cb-wvh26"
Jul 07 16:28:20.317809 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.317775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99ca7431-0efc-48e6-8402-27cd11fe971d-tls-cert\") pod \"authorino-77669df8cb-wvh26\" (UID: \"99ca7431-0efc-48e6-8402-27cd11fe971d\") " pod="kuadrant-system/authorino-77669df8cb-wvh26"
Jul 07 16:28:20.317809 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.317813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r66qf\" (UniqueName: \"kubernetes.io/projected/99ca7431-0efc-48e6-8402-27cd11fe971d-kube-api-access-r66qf\") pod \"authorino-77669df8cb-wvh26\" (UID: \"99ca7431-0efc-48e6-8402-27cd11fe971d\") " pod="kuadrant-system/authorino-77669df8cb-wvh26"
Jul 07 16:28:20.320138 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.320107    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99ca7431-0efc-48e6-8402-27cd11fe971d-tls-cert\") pod \"authorino-77669df8cb-wvh26\" (UID: \"99ca7431-0efc-48e6-8402-27cd11fe971d\") " pod="kuadrant-system/authorino-77669df8cb-wvh26"
Jul 07 16:28:20.326619 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.326598    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r66qf\" (UniqueName: \"kubernetes.io/projected/99ca7431-0efc-48e6-8402-27cd11fe971d-kube-api-access-r66qf\") pod \"authorino-77669df8cb-wvh26\" (UID: \"99ca7431-0efc-48e6-8402-27cd11fe971d\") " pod="kuadrant-system/authorino-77669df8cb-wvh26"
Jul 07 16:28:20.431737 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.431698    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77669df8cb-wvh26"
Jul 07 16:28:20.558493 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.558463    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77669df8cb-wvh26"]
Jul 07 16:28:20.561377 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:28:20.561353    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99ca7431_0efc_48e6_8402_27cd11fe971d.slice/crio-e9803d82d08a161143945a57733294f6877e03c19409c4551c3df31dffae7b79 WatchSource:0}: Error finding container e9803d82d08a161143945a57733294f6877e03c19409c4551c3df31dffae7b79: Status 404 returned error can't find the container with id e9803d82d08a161143945a57733294f6877e03c19409c4551c3df31dffae7b79
Jul 07 16:28:20.696220 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.695988    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-npn98" podUID="d57c30ce-29a5-456d-82ce-9ccdd0148d4e" containerName="authorino" containerID="cri-o://a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3" gracePeriod=30
Jul 07 16:28:20.696620 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.696284    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-npn98" event={"ID":"d57c30ce-29a5-456d-82ce-9ccdd0148d4e","Type":"ContainerStarted","Data":"a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3"}
Jul 07 16:28:20.696620 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.696333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-npn98" event={"ID":"d57c30ce-29a5-456d-82ce-9ccdd0148d4e","Type":"ContainerStarted","Data":"21e482a7b41f05d0ae8e9b2b9946b3a769b7765204555b6d68fd3f8f55c9fb2c"}
Jul 07 16:28:20.697618 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.697569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77669df8cb-wvh26" event={"ID":"99ca7431-0efc-48e6-8402-27cd11fe971d","Type":"ContainerStarted","Data":"e9803d82d08a161143945a57733294f6877e03c19409c4551c3df31dffae7b79"}
Jul 07 16:28:20.711780 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.711742    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-npn98" podStartSLOduration=1.310977999 podStartE2EDuration="1.711727619s" totalImagesPullingTime="400.74962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:20.711027053 +0000 UTC m=+594.065312335" watchObservedRunningTime="2026-07-07 16:28:20.711727619 +0000 UTC m=+594.066012866"
Jul 07 16:28:20.927203 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:20.927157    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-npn98"
Jul 07 16:28:21.023625 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.023589    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpn8b\" (UniqueName: \"kubernetes.io/projected/d57c30ce-29a5-456d-82ce-9ccdd0148d4e-kube-api-access-fpn8b\") pod \"d57c30ce-29a5-456d-82ce-9ccdd0148d4e\" (UID: \"d57c30ce-29a5-456d-82ce-9ccdd0148d4e\") "
Jul 07 16:28:21.025637 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.025603    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d57c30ce-29a5-456d-82ce-9ccdd0148d4e-kube-api-access-fpn8b" (OuterVolumeSpecName: "kube-api-access-fpn8b") pod "d57c30ce-29a5-456d-82ce-9ccdd0148d4e" (UID: "d57c30ce-29a5-456d-82ce-9ccdd0148d4e"). InnerVolumeSpecName "kube-api-access-fpn8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:28:21.124757 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.124730    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpn8b\" (UniqueName: \"kubernetes.io/projected/d57c30ce-29a5-456d-82ce-9ccdd0148d4e-kube-api-access-fpn8b\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:28:21.702816 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.702716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77669df8cb-wvh26" event={"ID":"99ca7431-0efc-48e6-8402-27cd11fe971d","Type":"ContainerStarted","Data":"0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9"}
Jul 07 16:28:21.703863 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.703821    2563 generic.go:356] "Generic (PLEG): container finished" podID="d57c30ce-29a5-456d-82ce-9ccdd0148d4e" containerID="a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3" exitCode=2
Jul 07 16:28:21.703953 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.703875    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-npn98"
Jul 07 16:28:21.703995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.703878    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-npn98" event={"ID":"d57c30ce-29a5-456d-82ce-9ccdd0148d4e","Type":"ContainerDied","Data":"a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3"}
Jul 07 16:28:21.703995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.703986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-npn98" event={"ID":"d57c30ce-29a5-456d-82ce-9ccdd0148d4e","Type":"ContainerDied","Data":"21e482a7b41f05d0ae8e9b2b9946b3a769b7765204555b6d68fd3f8f55c9fb2c"}
Jul 07 16:28:21.704053 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.704008    2563 scope.go:117] "RemoveContainer" containerID="a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3"
Jul 07 16:28:21.711511 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.711495    2563 scope.go:117] "RemoveContainer" containerID="a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3"
Jul 07 16:28:21.711793 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:28:21.711775    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3\": container with ID starting with a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3 not found: ID does not exist" containerID="a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3"
Jul 07 16:28:21.711858 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.711803    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3"} err="failed to get container status \"a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3\": rpc error: code = NotFound desc = could not find container \"a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3\": container with ID starting with a86431c2128ad208761526870c935e4998bb0dbc77ff2331bc3b71a5b7823bb3 not found: ID does not exist"
Jul 07 16:28:21.720137 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.720093    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77669df8cb-wvh26" podStartSLOduration=1.255039985 podStartE2EDuration="1.720077963s" totalImagesPullingTime="465.037978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:28:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:28:21.719482296 +0000 UTC m=+595.073767544" watchObservedRunningTime="2026-07-07 16:28:21.720077963 +0000 UTC m=+595.074363212"
Jul 07 16:28:21.735030 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.735008    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npn98"]
Jul 07 16:28:21.741201 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.741178    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-npn98"]
Jul 07 16:28:21.744893 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.744871    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcd5j"]
Jul 07 16:28:21.745074 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.745037    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hcd5j" podUID="769ce3bf-5073-4db7-9f28-fc242fcee820" containerName="authorino" containerID="cri-o://daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66" gracePeriod=30
Jul 07 16:28:21.984027 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:21.984003    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hcd5j"
Jul 07 16:28:22.032424 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.032393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfvs7\" (UniqueName: \"kubernetes.io/projected/769ce3bf-5073-4db7-9f28-fc242fcee820-kube-api-access-nfvs7\") pod \"769ce3bf-5073-4db7-9f28-fc242fcee820\" (UID: \"769ce3bf-5073-4db7-9f28-fc242fcee820\") "
Jul 07 16:28:22.034349 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.034328    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/769ce3bf-5073-4db7-9f28-fc242fcee820-kube-api-access-nfvs7" (OuterVolumeSpecName: "kube-api-access-nfvs7") pod "769ce3bf-5073-4db7-9f28-fc242fcee820" (UID: "769ce3bf-5073-4db7-9f28-fc242fcee820"). InnerVolumeSpecName "kube-api-access-nfvs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:28:22.133781 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.133749    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfvs7\" (UniqueName: \"kubernetes.io/projected/769ce3bf-5073-4db7-9f28-fc242fcee820-kube-api-access-nfvs7\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:28:22.708982 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.708948    2563 generic.go:356] "Generic (PLEG): container finished" podID="769ce3bf-5073-4db7-9f28-fc242fcee820" containerID="daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66" exitCode=0
Jul 07 16:28:22.709422 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.708988    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hcd5j"
Jul 07 16:28:22.709422 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.709031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hcd5j" event={"ID":"769ce3bf-5073-4db7-9f28-fc242fcee820","Type":"ContainerDied","Data":"daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66"}
Jul 07 16:28:22.709422 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.709075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hcd5j" event={"ID":"769ce3bf-5073-4db7-9f28-fc242fcee820","Type":"ContainerDied","Data":"2f7bec6120d5080478a2a62aba6fbcd302bd8ea71972cedfdc7e15b5faefbac1"}
Jul 07 16:28:22.709422 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.709096    2563 scope.go:117] "RemoveContainer" containerID="daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66"
Jul 07 16:28:22.717075 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.717061    2563 scope.go:117] "RemoveContainer" containerID="daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66"
Jul 07 16:28:22.717342 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:28:22.717322    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66\": container with ID starting with daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66 not found: ID does not exist" containerID="daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66"
Jul 07 16:28:22.717380 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.717350    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66"} err="failed to get container status \"daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66\": rpc error: code = NotFound desc = could not find container \"daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66\": container with ID starting with daf41a6e3941e599d24739ec1d2b3db7926f88e90695ce48c8faca6ac92f5e66 not found: ID does not exist"
Jul 07 16:28:22.730332 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.730308    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcd5j"]
Jul 07 16:28:22.733598 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:22.733577    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hcd5j"]
Jul 07 16:28:23.387142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:23.387107    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="769ce3bf-5073-4db7-9f28-fc242fcee820" path="/var/lib/kubelet/pods/769ce3bf-5073-4db7-9f28-fc242fcee820/volumes"
Jul 07 16:28:23.387508 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:23.387489    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d57c30ce-29a5-456d-82ce-9ccdd0148d4e" path="/var/lib/kubelet/pods/d57c30ce-29a5-456d-82ce-9ccdd0148d4e/volumes"
Jul 07 16:28:26.140679 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:26.140645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:28:26.250680 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:26.250644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:28:26.380600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:26.380562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:28:29.809429 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:29.809392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:28:29.902505 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:29.902471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:28:43.436309 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:28:43.436276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:01.135812 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:01.135734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:01.551195 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:01.551128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:01.722572 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:01.722539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:02.166158 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:02.166123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:02.266479 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:02.266446    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:04.270596 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:04.270562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:12.615892 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:12.615858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:12.715313 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:12.715270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:16.800750 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:16.800716    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:24.823633 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:24.823599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:39.428884 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:39.428849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:42.350763 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.350727    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"]
Jul 07 16:29:42.351213 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.351192    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d57c30ce-29a5-456d-82ce-9ccdd0148d4e" containerName="authorino"
Jul 07 16:29:42.351301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.351217    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d57c30ce-29a5-456d-82ce-9ccdd0148d4e" containerName="authorino"
Jul 07 16:29:42.351301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.351240    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="769ce3bf-5073-4db7-9f28-fc242fcee820" containerName="authorino"
Jul 07 16:29:42.351301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.351249    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="769ce3bf-5073-4db7-9f28-fc242fcee820" containerName="authorino"
Jul 07 16:29:42.351423 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.351352    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d57c30ce-29a5-456d-82ce-9ccdd0148d4e" containerName="authorino"
Jul 07 16:29:42.351423 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.351366    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="769ce3bf-5073-4db7-9f28-fc242fcee820" containerName="authorino"
Jul 07 16:29:42.354537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.354517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.358560 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.358537    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 16:29:42.358682 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.358572    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-crwj9\""
Jul 07 16:29:42.358682 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.358588    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 16:29:42.358682 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.358608    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 16:29:42.364489 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.364465    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"]
Jul 07 16:29:42.386137 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.386108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:42.447476 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.447444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.447626 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.447479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.447626 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.447500    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.447626 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.447580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49546\" (UniqueName: \"kubernetes.io/projected/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-kube-api-access-49546\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.447626 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.447618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.447764 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.447646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.548382 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.548345    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.548567 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.548392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.548567 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.548447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.548567 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.548477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.548744 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.548617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.548744 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.548684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49546\" (UniqueName: \"kubernetes.io/projected/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-kube-api-access-49546\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.548872 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.548767    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.548872 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.548818    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.548955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.548920    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.550582 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.550562    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.551043 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.551023    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.557230 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.557208    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49546\" (UniqueName: \"kubernetes.io/projected/7b8dea16-7f86-4ff4-b82d-3ea724ffbf52-kube-api-access-49546\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc\" (UID: \"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.667191 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.667157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:42.793815 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.793783    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"]
Jul 07 16:29:42.796825 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:29:42.796796    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8dea16_7f86_4ff4_b82d_3ea724ffbf52.slice/crio-bf94f5fc7c6650bdb43467d221fc853bad38cf4cd1d142528c5915c713b2d8be WatchSource:0}: Error finding container bf94f5fc7c6650bdb43467d221fc853bad38cf4cd1d142528c5915c713b2d8be: Status 404 returned error can't find the container with id bf94f5fc7c6650bdb43467d221fc853bad38cf4cd1d142528c5915c713b2d8be
Jul 07 16:29:42.798092 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:42.798074    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:29:43.026956 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:43.026875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc" event={"ID":"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52","Type":"ContainerStarted","Data":"bf94f5fc7c6650bdb43467d221fc853bad38cf4cd1d142528c5915c713b2d8be"}
Jul 07 16:29:44.032886 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:44.032822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc" event={"ID":"7b8dea16-7f86-4ff4-b82d-3ea724ffbf52","Type":"ContainerStarted","Data":"5baea27976ab11d7f0bb60d33367b220da6a06e9a25eadc1932a3ce02317b494"}
Jul 07 16:29:52.038052 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:52.038012    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:52.139467 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:52.139432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:29:52.667641 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:52.667609    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:52.667807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:52.667686    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:52.679670 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:52.679646    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:52.697409 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:52.697373    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc" podStartSLOduration=9.678318514 podStartE2EDuration="10.697346133s" totalImagesPullingTime="1.019027619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:29:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:29:44.057463299 +0000 UTC m=+677.411748546" watchObservedRunningTime="2026-07-07 16:29:52.697346133 +0000 UTC m=+686.051631375"
Jul 07 16:29:53.082266 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:53.082181    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc"
Jul 07 16:29:58.988721 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:29:58.988684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:30:04.870489 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:04.870441    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"]
Jul 07 16:30:04.873657 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:04.873640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:04.879120 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:04.879095    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 16:30:04.903788 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:04.903764    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"]
Jul 07 16:30:04.963494 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:04.963463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:30:05.028299 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.028263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.028299 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.028296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.028492 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.028318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgrs2\" (UniqueName: \"kubernetes.io/projected/6375b27b-9c80-449e-967b-07ef9304331c-kube-api-access-xgrs2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.028492 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.028345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.028492 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.028398    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6375b27b-9c80-449e-967b-07ef9304331c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.028492 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.028431    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.128821 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.128744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.128821 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.128793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.128821 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.128813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.129099 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.128832    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgrs2\" (UniqueName: \"kubernetes.io/projected/6375b27b-9c80-449e-967b-07ef9304331c-kube-api-access-xgrs2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.129099 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.128883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.129099 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.128916    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6375b27b-9c80-449e-967b-07ef9304331c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.129245 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.129223    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.129310 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.129233    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.129363 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.129335    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.131097 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.131081    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6375b27b-9c80-449e-967b-07ef9304331c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.131341 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.131324    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6375b27b-9c80-449e-967b-07ef9304331c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.137680 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.137657    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgrs2\" (UniqueName: \"kubernetes.io/projected/6375b27b-9c80-449e-967b-07ef9304331c-kube-api-access-xgrs2\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd\" (UID: \"6375b27b-9c80-449e-967b-07ef9304331c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.182059 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.182029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:05.316273 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:05.316248    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"]
Jul 07 16:30:05.318674 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:30:05.318645    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6375b27b_9c80_449e_967b_07ef9304331c.slice/crio-d6886b98bee9d4ca85f1f5290841f415ca775e069b580073b10c6dff5c3916e4 WatchSource:0}: Error finding container d6886b98bee9d4ca85f1f5290841f415ca775e069b580073b10c6dff5c3916e4: Status 404 returned error can't find the container with id d6886b98bee9d4ca85f1f5290841f415ca775e069b580073b10c6dff5c3916e4
Jul 07 16:30:06.121652 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:06.121618    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd" event={"ID":"6375b27b-9c80-449e-967b-07ef9304331c","Type":"ContainerStarted","Data":"d6886b98bee9d4ca85f1f5290841f415ca775e069b580073b10c6dff5c3916e4"}
Jul 07 16:30:07.126769 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:07.126731    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd" event={"ID":"6375b27b-9c80-449e-967b-07ef9304331c","Type":"ContainerStarted","Data":"0f6bf9d1c6f971ebedc43ffa7a9b0a82c0d6c570c6e928b3a2320a9e970c929d"}
Jul 07 16:30:07.152032 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:07.151985    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd" podStartSLOduration=1.953025767 podStartE2EDuration="3.151969995s" totalImagesPullingTime="1.198944228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:30:07.151282314 +0000 UTC m=+700.505567561" watchObservedRunningTime="2026-07-07 16:30:07.151969995 +0000 UTC m=+700.506255272"
Jul 07 16:30:13.900327 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:13.900293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:30:15.183086 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:15.183050    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:15.183086 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:15.183093    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:15.194969 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:15.194947    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:30:16.173948 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:30:16.173916    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd"
Jul 07 16:31:10.230375 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.230340    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f69db59d9-5q4hc"]
Jul 07 16:31:10.233558 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.233538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f69db59d9-5q4hc"
Jul 07 16:31:10.246860 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.246816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f69db59d9-5q4hc"]
Jul 07 16:31:10.362413 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.362376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55bbb774-91d5-4835-a1ec-45dc26bce916-tls-cert\") pod \"authorino-7f69db59d9-5q4hc\" (UID: \"55bbb774-91d5-4835-a1ec-45dc26bce916\") " pod="kuadrant-system/authorino-7f69db59d9-5q4hc"
Jul 07 16:31:10.362588 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.362477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgffz\" (UniqueName: \"kubernetes.io/projected/55bbb774-91d5-4835-a1ec-45dc26bce916-kube-api-access-mgffz\") pod \"authorino-7f69db59d9-5q4hc\" (UID: \"55bbb774-91d5-4835-a1ec-45dc26bce916\") " pod="kuadrant-system/authorino-7f69db59d9-5q4hc"
Jul 07 16:31:10.463642 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.463600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgffz\" (UniqueName: \"kubernetes.io/projected/55bbb774-91d5-4835-a1ec-45dc26bce916-kube-api-access-mgffz\") pod \"authorino-7f69db59d9-5q4hc\" (UID: \"55bbb774-91d5-4835-a1ec-45dc26bce916\") " pod="kuadrant-system/authorino-7f69db59d9-5q4hc"
Jul 07 16:31:10.463832 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.463658    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55bbb774-91d5-4835-a1ec-45dc26bce916-tls-cert\") pod \"authorino-7f69db59d9-5q4hc\" (UID: \"55bbb774-91d5-4835-a1ec-45dc26bce916\") " pod="kuadrant-system/authorino-7f69db59d9-5q4hc"
Jul 07 16:31:10.466132 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.466113    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/55bbb774-91d5-4835-a1ec-45dc26bce916-tls-cert\") pod \"authorino-7f69db59d9-5q4hc\" (UID: \"55bbb774-91d5-4835-a1ec-45dc26bce916\") " pod="kuadrant-system/authorino-7f69db59d9-5q4hc"
Jul 07 16:31:10.472380 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.472355    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgffz\" (UniqueName: \"kubernetes.io/projected/55bbb774-91d5-4835-a1ec-45dc26bce916-kube-api-access-mgffz\") pod \"authorino-7f69db59d9-5q4hc\" (UID: \"55bbb774-91d5-4835-a1ec-45dc26bce916\") " pod="kuadrant-system/authorino-7f69db59d9-5q4hc"
Jul 07 16:31:10.541958 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.541864    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f69db59d9-5q4hc"
Jul 07 16:31:10.676357 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.676335    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f69db59d9-5q4hc"]
Jul 07 16:31:10.678880 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:31:10.678826    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55bbb774_91d5_4835_a1ec_45dc26bce916.slice/crio-6930e504411b00581fbec7d32b1409e325f890d03b4846ba61e8ec12cdc6430d WatchSource:0}: Error finding container 6930e504411b00581fbec7d32b1409e325f890d03b4846ba61e8ec12cdc6430d: Status 404 returned error can't find the container with id 6930e504411b00581fbec7d32b1409e325f890d03b4846ba61e8ec12cdc6430d
Jul 07 16:31:10.703604 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.703575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:31:10.811679 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:10.811590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:31:11.389326 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.389287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f69db59d9-5q4hc" event={"ID":"55bbb774-91d5-4835-a1ec-45dc26bce916","Type":"ContainerStarted","Data":"b791c41ed9fcdaee4e489d9244c85ddb83743e50ba3136c52c3c4db9c2c29b2b"}
Jul 07 16:31:11.389326 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.389332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f69db59d9-5q4hc" event={"ID":"55bbb774-91d5-4835-a1ec-45dc26bce916","Type":"ContainerStarted","Data":"6930e504411b00581fbec7d32b1409e325f890d03b4846ba61e8ec12cdc6430d"}
Jul 07 16:31:11.442252 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.442190    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f69db59d9-5q4hc" podStartSLOduration=1.020774347 podStartE2EDuration="1.44216822s" totalImagesPullingTime="421.393873ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:31:11.441790578 +0000 UTC m=+764.796075827" watchObservedRunningTime="2026-07-07 16:31:11.44216822 +0000 UTC m=+764.796453470"
Jul 07 16:31:11.478208 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.478174    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77669df8cb-wvh26"]
Jul 07 16:31:11.478611 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.478584    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-77669df8cb-wvh26" podUID="99ca7431-0efc-48e6-8402-27cd11fe971d" containerName="authorino" containerID="cri-o://0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9" gracePeriod=30
Jul 07 16:31:11.737924 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.737896    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77669df8cb-wvh26"
Jul 07 16:31:11.871048 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.871015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:31:11.876090 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.876068    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99ca7431-0efc-48e6-8402-27cd11fe971d-tls-cert\") pod \"99ca7431-0efc-48e6-8402-27cd11fe971d\" (UID: \"99ca7431-0efc-48e6-8402-27cd11fe971d\") "
Jul 07 16:31:11.876186 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.876134    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r66qf\" (UniqueName: \"kubernetes.io/projected/99ca7431-0efc-48e6-8402-27cd11fe971d-kube-api-access-r66qf\") pod \"99ca7431-0efc-48e6-8402-27cd11fe971d\" (UID: \"99ca7431-0efc-48e6-8402-27cd11fe971d\") "
Jul 07 16:31:11.878129 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.878097    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99ca7431-0efc-48e6-8402-27cd11fe971d-kube-api-access-r66qf" (OuterVolumeSpecName: "kube-api-access-r66qf") pod "99ca7431-0efc-48e6-8402-27cd11fe971d" (UID: "99ca7431-0efc-48e6-8402-27cd11fe971d"). InnerVolumeSpecName "kube-api-access-r66qf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:31:11.887408 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.887379    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99ca7431-0efc-48e6-8402-27cd11fe971d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "99ca7431-0efc-48e6-8402-27cd11fe971d" (UID: "99ca7431-0efc-48e6-8402-27cd11fe971d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:31:11.970718 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.970621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:31:11.976788 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.976754    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/99ca7431-0efc-48e6-8402-27cd11fe971d-tls-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:31:11.976788 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:11.976783    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r66qf\" (UniqueName: \"kubernetes.io/projected/99ca7431-0efc-48e6-8402-27cd11fe971d-kube-api-access-r66qf\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:31:12.398371 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:12.398324    2563 generic.go:356] "Generic (PLEG): container finished" podID="99ca7431-0efc-48e6-8402-27cd11fe971d" containerID="0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9" exitCode=0
Jul 07 16:31:12.399002 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:12.398981    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77669df8cb-wvh26"
Jul 07 16:31:12.403910 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:12.403881    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77669df8cb-wvh26" event={"ID":"99ca7431-0efc-48e6-8402-27cd11fe971d","Type":"ContainerDied","Data":"0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9"}
Jul 07 16:31:12.404041 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:12.403925    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77669df8cb-wvh26" event={"ID":"99ca7431-0efc-48e6-8402-27cd11fe971d","Type":"ContainerDied","Data":"e9803d82d08a161143945a57733294f6877e03c19409c4551c3df31dffae7b79"}
Jul 07 16:31:12.404041 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:12.403947    2563 scope.go:117] "RemoveContainer" containerID="0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9"
Jul 07 16:31:12.416922 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:12.416906    2563 scope.go:117] "RemoveContainer" containerID="0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9"
Jul 07 16:31:12.417228 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:31:12.417207    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9\": container with ID starting with 0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9 not found: ID does not exist" containerID="0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9"
Jul 07 16:31:12.417302 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:12.417236    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9"} err="failed to get container status \"0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9\": rpc error: code = NotFound desc = could not find container \"0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9\": container with ID starting with 0f9e92120d8926833fc3b092e765230a0b75d5b535f678fabcc98f98aa17ece9 not found: ID does not exist"
Jul 07 16:31:12.426237 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:12.426212    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77669df8cb-wvh26"]
Jul 07 16:31:12.431428 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:12.431406    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77669df8cb-wvh26"]
Jul 07 16:31:13.388638 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:13.388604    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99ca7431-0efc-48e6-8402-27cd11fe971d" path="/var/lib/kubelet/pods/99ca7431-0efc-48e6-8402-27cd11fe971d/volumes"
Jul 07 16:31:26.402269 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:26.402228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:31:26.466253 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:31:26.466221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:32:23.037527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:32:23.037490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:32:24.221089 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:32:24.221049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:32:40.086230 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:32:40.086199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:32:40.187652 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:32:40.187613    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:33:05.204976 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:33:05.204945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:33:05.293415 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:33:05.293382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:33:05.419314 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:33:05.419283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:33:11.424703 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:33:11.424670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:33:11.525617 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:33:11.525588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:33:11.643054 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:33:11.643021    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:33:11.792874 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:33:11.792776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:33:17.631395 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:33:17.631361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:33:17.732336 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:33:17.732303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:34:56.055372 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:34:56.055290    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:35:00.225907 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:35:00.225873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:36:46.652888 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:36:46.652822    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:36:46.739568 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:36:46.739531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:37:42.874136 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:37:42.874100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:38:41.475807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:38:41.475766    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:41:12.895596 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:41:12.895523    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:01.082111 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:01.082024    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:05.475200 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:05.475163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:13.741791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:13.741754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:18.876362 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:18.876326    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:21.783437 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:21.783390    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:21.885264 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:21.885223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:22.227800 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:22.227769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:28.105885 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.105813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:28.206132 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.206090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:28.321323 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.321293    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"]
Jul 07 16:44:28.321800 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.321781    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99ca7431-0efc-48e6-8402-27cd11fe971d" containerName="authorino"
Jul 07 16:44:28.321865 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.321806    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="99ca7431-0efc-48e6-8402-27cd11fe971d" containerName="authorino"
Jul 07 16:44:28.321923 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.321909    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="99ca7431-0efc-48e6-8402-27cd11fe971d" containerName="authorino"
Jul 07 16:44:28.325148 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.325130    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.328206 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.328186    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b15c8f0d-openshift-default-dockercfg-vwjqb\""
Jul 07 16:44:28.361459 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.361439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"]
Jul 07 16:44:28.374202 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.374181    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193155e1-4af4-48e1-b5ce-1c61658a7556-istiod-ca-cert\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.374309 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.374213    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-socket\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.374309 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.374274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-certs\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.374309 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.374295    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-envoy\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.374476 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.374327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-data\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.374476 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.374355    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxbrj\" (UniqueName: \"kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-kube-api-access-vxbrj\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.374476 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.374379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-credential-socket\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.374476 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.374403    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-podinfo\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.374654 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.374472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-token\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.375341 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.375322    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:28.470872 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.470823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:28.475004 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.474985    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxbrj\" (UniqueName: \"kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-kube-api-access-vxbrj\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475079 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-credential-socket\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475079 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-podinfo\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475079 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-token\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475281 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193155e1-4af4-48e1-b5ce-1c61658a7556-istiod-ca-cert\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475281 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-socket\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475281 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475181    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-certs\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475281 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-envoy\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475465 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-data\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475518 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475471    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-credential-socket\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475518 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475508    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-socket\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475636 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475612    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-data\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475698 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475636    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-certs\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.475874 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.475823    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193155e1-4af4-48e1-b5ce-1c61658a7556-istiod-ca-cert\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.477387 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.477366    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-envoy\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.477694 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.477670    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-podinfo\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.485453 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.485432    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-token\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.485543 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.485515    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxbrj\" (UniqueName: \"kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-kube-api-access-vxbrj\") pod \"e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") " pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.635462 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.635376    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:28.769421 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.769392    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"]
Jul 07 16:44:28.771914 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:44:28.771886    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193155e1_4af4_48e1_b5ce_1c61658a7556.slice/crio-ad59fb3e0030309332ed1fe27e6f8a63e2d0f207931b46e95edbadb5b9527ef3 WatchSource:0}: Error finding container ad59fb3e0030309332ed1fe27e6f8a63e2d0f207931b46e95edbadb5b9527ef3: Status 404 returned error can't find the container with id ad59fb3e0030309332ed1fe27e6f8a63e2d0f207931b46e95edbadb5b9527ef3
Jul 07 16:44:28.773925 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.773896    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:44:28.774004 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.773967    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:44:28.774004 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:28.773996    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:44:29.467052 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:29.467005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:29.582208 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:29.582174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:29.587084 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:29.587056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s" event={"ID":"193155e1-4af4-48e1-b5ce-1c61658a7556","Type":"ContainerStarted","Data":"910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f"}
Jul 07 16:44:29.587238 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:29.587104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s" event={"ID":"193155e1-4af4-48e1-b5ce-1c61658a7556","Type":"ContainerStarted","Data":"ad59fb3e0030309332ed1fe27e6f8a63e2d0f207931b46e95edbadb5b9527ef3"}
Jul 07 16:44:29.624242 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:29.624188    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s" podStartSLOduration=1.6241739800000001 podStartE2EDuration="1.62417398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:44:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:44:29.621360133 +0000 UTC m=+1562.975645381" watchObservedRunningTime="2026-07-07 16:44:29.62417398 +0000 UTC m=+1562.978459227"
Jul 07 16:44:29.635722 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:29.635698    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:29.640114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:29.640096    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:29.679979 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:29.679948    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:29.765931 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:29.765831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:30.125368 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:30.125337    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:30.226304 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:30.226261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:30.592071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:30.591998    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:30.592982 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:30.592963    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:32.267668 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:32.267643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:34.578889 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:34.578852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:34.745286 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:34.745246    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"]
Jul 07 16:44:34.745851 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:34.745782    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s" podUID="193155e1-4af4-48e1-b5ce-1c61658a7556" containerName="istio-proxy" containerID="cri-o://910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f" gracePeriod=30
Jul 07 16:44:34.778793 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:34.778759    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:34.864075 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:34.864016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:34.964624 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:34.964584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:36.640572 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:36.640538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:40.595537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.595480    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:40.634334 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.634308    2563 generic.go:356] "Generic (PLEG): container finished" podID="193155e1-4af4-48e1-b5ce-1c61658a7556" containerID="910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f" exitCode=0
Jul 07 16:44:40.634473 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.634342    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s" event={"ID":"193155e1-4af4-48e1-b5ce-1c61658a7556","Type":"ContainerDied","Data":"910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f"}
Jul 07 16:44:40.634473 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.634353    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"
Jul 07 16:44:40.634473 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.634379    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s" event={"ID":"193155e1-4af4-48e1-b5ce-1c61658a7556","Type":"ContainerDied","Data":"ad59fb3e0030309332ed1fe27e6f8a63e2d0f207931b46e95edbadb5b9527ef3"}
Jul 07 16:44:40.634473 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.634409    2563 scope.go:117] "RemoveContainer" containerID="910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f"
Jul 07 16:44:40.642402 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.642373    2563 scope.go:117] "RemoveContainer" containerID="910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f"
Jul 07 16:44:40.642672 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:44:40.642652    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f\": container with ID starting with 910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f not found: ID does not exist" containerID="910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f"
Jul 07 16:44:40.642719 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.642681    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f"} err="failed to get container status \"910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f\": rpc error: code = NotFound desc = could not find container \"910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f\": container with ID starting with 910a0db43ca730c393f875fab3fe66ec0968a68803ef973c7dd9d41b7098048f not found: ID does not exist"
Jul 07 16:44:40.660999 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.660972    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-podinfo\") pod \"193155e1-4af4-48e1-b5ce-1c61658a7556\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") "
Jul 07 16:44:40.661095 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661036    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-socket\") pod \"193155e1-4af4-48e1-b5ce-1c61658a7556\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") "
Jul 07 16:44:40.661095 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661087    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxbrj\" (UniqueName: \"kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-kube-api-access-vxbrj\") pod \"193155e1-4af4-48e1-b5ce-1c61658a7556\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") "
Jul 07 16:44:40.661181 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661119    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-credential-socket\") pod \"193155e1-4af4-48e1-b5ce-1c61658a7556\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") "
Jul 07 16:44:40.661181 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661162    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-token\") pod \"193155e1-4af4-48e1-b5ce-1c61658a7556\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") "
Jul 07 16:44:40.661288 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661198    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-envoy\") pod \"193155e1-4af4-48e1-b5ce-1c61658a7556\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") "
Jul 07 16:44:40.661288 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661230    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "193155e1-4af4-48e1-b5ce-1c61658a7556" (UID: "193155e1-4af4-48e1-b5ce-1c61658a7556"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:44:40.661288 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661237    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-certs\") pod \"193155e1-4af4-48e1-b5ce-1c61658a7556\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") "
Jul 07 16:44:40.661288 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661267    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193155e1-4af4-48e1-b5ce-1c61658a7556-istiod-ca-cert\") pod \"193155e1-4af4-48e1-b5ce-1c61658a7556\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") "
Jul 07 16:44:40.661496 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661329    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-data\") pod \"193155e1-4af4-48e1-b5ce-1c61658a7556\" (UID: \"193155e1-4af4-48e1-b5ce-1c61658a7556\") "
Jul 07 16:44:40.661496 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661387    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "193155e1-4af4-48e1-b5ce-1c61658a7556" (UID: "193155e1-4af4-48e1-b5ce-1c61658a7556"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:44:40.661604 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661495    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "193155e1-4af4-48e1-b5ce-1c61658a7556" (UID: "193155e1-4af4-48e1-b5ce-1c61658a7556"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:44:40.661604 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661596    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:40.661707 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661613    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:40.661707 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661627    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:40.661877 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.661705    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/193155e1-4af4-48e1-b5ce-1c61658a7556-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "193155e1-4af4-48e1-b5ce-1c61658a7556" (UID: "193155e1-4af4-48e1-b5ce-1c61658a7556"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:44:40.662410 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.662376    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-data" (OuterVolumeSpecName: "istio-data") pod "193155e1-4af4-48e1-b5ce-1c61658a7556" (UID: "193155e1-4af4-48e1-b5ce-1c61658a7556"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:44:40.663198 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.663171    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "193155e1-4af4-48e1-b5ce-1c61658a7556" (UID: "193155e1-4af4-48e1-b5ce-1c61658a7556"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:44:40.663275 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.663224    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-token" (OuterVolumeSpecName: "istio-token") pod "193155e1-4af4-48e1-b5ce-1c61658a7556" (UID: "193155e1-4af4-48e1-b5ce-1c61658a7556"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:44:40.663322 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.663289    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-kube-api-access-vxbrj" (OuterVolumeSpecName: "kube-api-access-vxbrj") pod "193155e1-4af4-48e1-b5ce-1c61658a7556" (UID: "193155e1-4af4-48e1-b5ce-1c61658a7556"). InnerVolumeSpecName "kube-api-access-vxbrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:44:40.663360 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.663346    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "193155e1-4af4-48e1-b5ce-1c61658a7556" (UID: "193155e1-4af4-48e1-b5ce-1c61658a7556"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:44:40.762600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.762513    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/193155e1-4af4-48e1-b5ce-1c61658a7556-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:40.762600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.762541    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:40.762600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.762551    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:40.762600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.762560    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxbrj\" (UniqueName: \"kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-kube-api-access-vxbrj\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:40.762600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.762567    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:40.762600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.762576    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/193155e1-4af4-48e1-b5ce-1c61658a7556-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:40.817136 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.817096    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:40.921421 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.921394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:40.963593 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.963564    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"]
Jul 07 16:44:40.967791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:40.967772    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b15c8f0d-openshift-default-59c7b956fc-zph4s"]
Jul 07 16:44:41.006340 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.006307    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"]
Jul 07 16:44:41.006766 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.006748    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193155e1-4af4-48e1-b5ce-1c61658a7556" containerName="istio-proxy"
Jul 07 16:44:41.006864 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.006771    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="193155e1-4af4-48e1-b5ce-1c61658a7556" containerName="istio-proxy"
Jul 07 16:44:41.006963 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.006885    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="193155e1-4af4-48e1-b5ce-1c61658a7556" containerName="istio-proxy"
Jul 07 16:44:41.011306 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.011288    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.014592 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.014549    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3b3b9194-openshift-default-dockercfg-vthdv\""
Jul 07 16:44:41.022948 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.022923    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"]
Jul 07 16:44:41.045647 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.045609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:41.064424 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.064405    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-credential-socket\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.064525 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.064449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-socket\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.064525 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.064466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-token\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.064617 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.064531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bacf102-dca2-40bd-9a53-a18d36079a93-istiod-ca-cert\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.064617 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.064564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-envoy\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.064617 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.064588    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-certs\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.064617 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.064603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-data\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.064796 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.064622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-podinfo\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.064796 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.064639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v27v5\" (UniqueName: \"kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-kube-api-access-v27v5\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.147058 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.147027    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:41.165859 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.165814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-podinfo\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.165992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.165861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v27v5\" (UniqueName: \"kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-kube-api-access-v27v5\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.165992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.165904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-credential-socket\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.165992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.165968    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-socket\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.166149 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.165992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-token\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.166149 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.166038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bacf102-dca2-40bd-9a53-a18d36079a93-istiod-ca-cert\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.166239 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.166163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-envoy\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.166239 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.166224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-certs\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.166339 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.166251    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-data\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.166455 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.166431    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-credential-socket\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.166527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.166452    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-socket\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.166612 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.166583    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-certs\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.166722 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.166608    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-data\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.166785 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.166769    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bacf102-dca2-40bd-9a53-a18d36079a93-istiod-ca-cert\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.168326 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.168305    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-envoy\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.168411 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.168330    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-podinfo\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.174589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.174564    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-token\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.174781 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.174764    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v27v5\" (UniqueName: \"kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-kube-api-access-v27v5\") pod \"e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") " pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.322246 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.322175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:41.388714 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.388679    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="193155e1-4af4-48e1-b5ce-1c61658a7556" path="/var/lib/kubelet/pods/193155e1-4af4-48e1-b5ce-1c61658a7556/volumes"
Jul 07 16:44:41.457623 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.457602    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"]
Jul 07 16:44:41.459759 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:44:41.459731    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bacf102_dca2_40bd_9a53_a18d36079a93.slice/crio-de448cb7408ebf70b244b842a8b948bccccbc4d4012f0992304139ffab831e08 WatchSource:0}: Error finding container de448cb7408ebf70b244b842a8b948bccccbc4d4012f0992304139ffab831e08: Status 404 returned error can't find the container with id de448cb7408ebf70b244b842a8b948bccccbc4d4012f0992304139ffab831e08
Jul 07 16:44:41.461968 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.461933    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:44:41.462050 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.462011    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:44:41.462088 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.462051    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:44:41.640647 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.640605    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj" event={"ID":"3bacf102-dca2-40bd-9a53-a18d36079a93","Type":"ContainerStarted","Data":"cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd"}
Jul 07 16:44:41.641163 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.640673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj" event={"ID":"3bacf102-dca2-40bd-9a53-a18d36079a93","Type":"ContainerStarted","Data":"de448cb7408ebf70b244b842a8b948bccccbc4d4012f0992304139ffab831e08"}
Jul 07 16:44:41.664404 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:41.664349    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj" podStartSLOduration=1.664334018 podStartE2EDuration="1.664334018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:44:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:44:41.66278426 +0000 UTC m=+1575.017069519" watchObservedRunningTime="2026-07-07 16:44:41.664334018 +0000 UTC m=+1575.018619265"
Jul 07 16:44:42.163028 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:42.162990    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:42.256727 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:42.256696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:42.322753 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:42.322724    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:42.327605 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:42.327578    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:42.406587 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:42.406551    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:42.645600 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:42.645564    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:42.646691 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:42.646659    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:42.699145 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:42.699114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:43.087907 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:43.087810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:43.188714 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:43.188686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:44.619456 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:44.619430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:47.313529 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:47.313492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:47.746266 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:47.746230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:53.409253 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.409219    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"]
Jul 07 16:44:53.409711 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.409442    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj" podUID="3bacf102-dca2-40bd-9a53-a18d36079a93" containerName="istio-proxy" containerID="cri-o://cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd" gracePeriod=30
Jul 07 16:44:53.434034 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.433995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:53.533930 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.533900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:53.946667 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.946639    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:53.967778 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.967756    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bacf102-dca2-40bd-9a53-a18d36079a93-istiod-ca-cert\") pod \"3bacf102-dca2-40bd-9a53-a18d36079a93\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") "
Jul 07 16:44:53.967925 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.967854    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-token\") pod \"3bacf102-dca2-40bd-9a53-a18d36079a93\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") "
Jul 07 16:44:53.967925 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.967920    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-socket\") pod \"3bacf102-dca2-40bd-9a53-a18d36079a93\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") "
Jul 07 16:44:53.968035 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.967949    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-envoy\") pod \"3bacf102-dca2-40bd-9a53-a18d36079a93\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") "
Jul 07 16:44:53.968035 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.967972    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-podinfo\") pod \"3bacf102-dca2-40bd-9a53-a18d36079a93\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") "
Jul 07 16:44:53.968035 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.968002    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-certs\") pod \"3bacf102-dca2-40bd-9a53-a18d36079a93\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") "
Jul 07 16:44:53.968176 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.968132    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-data\") pod \"3bacf102-dca2-40bd-9a53-a18d36079a93\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") "
Jul 07 16:44:53.968230 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.968181    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v27v5\" (UniqueName: \"kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-kube-api-access-v27v5\") pod \"3bacf102-dca2-40bd-9a53-a18d36079a93\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") "
Jul 07 16:44:53.968230 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.968216    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-credential-socket\") pod \"3bacf102-dca2-40bd-9a53-a18d36079a93\" (UID: \"3bacf102-dca2-40bd-9a53-a18d36079a93\") "
Jul 07 16:44:53.968331 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.968308    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3bacf102-dca2-40bd-9a53-a18d36079a93" (UID: "3bacf102-dca2-40bd-9a53-a18d36079a93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:44:53.969225 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.968541    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:53.969225 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.968801    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3bacf102-dca2-40bd-9a53-a18d36079a93" (UID: "3bacf102-dca2-40bd-9a53-a18d36079a93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:44:53.969225 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.968984    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3bacf102-dca2-40bd-9a53-a18d36079a93" (UID: "3bacf102-dca2-40bd-9a53-a18d36079a93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:44:53.969569 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.969380    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-data" (OuterVolumeSpecName: "istio-data") pod "3bacf102-dca2-40bd-9a53-a18d36079a93" (UID: "3bacf102-dca2-40bd-9a53-a18d36079a93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:44:53.970965 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.970926    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3bacf102-dca2-40bd-9a53-a18d36079a93" (UID: "3bacf102-dca2-40bd-9a53-a18d36079a93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:44:53.971248 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.971167    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-token" (OuterVolumeSpecName: "istio-token") pod "3bacf102-dca2-40bd-9a53-a18d36079a93" (UID: "3bacf102-dca2-40bd-9a53-a18d36079a93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:44:53.971383 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.971360    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bacf102-dca2-40bd-9a53-a18d36079a93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3bacf102-dca2-40bd-9a53-a18d36079a93" (UID: "3bacf102-dca2-40bd-9a53-a18d36079a93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:44:53.971589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.971563    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-kube-api-access-v27v5" (OuterVolumeSpecName: "kube-api-access-v27v5") pod "3bacf102-dca2-40bd-9a53-a18d36079a93" (UID: "3bacf102-dca2-40bd-9a53-a18d36079a93"). InnerVolumeSpecName "kube-api-access-v27v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:44:53.972538 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:53.972517    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3bacf102-dca2-40bd-9a53-a18d36079a93" (UID: "3bacf102-dca2-40bd-9a53-a18d36079a93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:44:54.068938 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.068909    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:54.068938 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.068932    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:54.068938 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.068941    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:54.069142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.068949    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:54.069142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.068957    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v27v5\" (UniqueName: \"kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-kube-api-access-v27v5\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:54.069142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.068966    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bacf102-dca2-40bd-9a53-a18d36079a93-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:54.069142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.068974    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bacf102-dca2-40bd-9a53-a18d36079a93-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:54.069142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.068982    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bacf102-dca2-40bd-9a53-a18d36079a93-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:44:54.697791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.697760    2563 generic.go:356] "Generic (PLEG): container finished" podID="3bacf102-dca2-40bd-9a53-a18d36079a93" containerID="cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd" exitCode=0
Jul 07 16:44:54.698230 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.697804    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"
Jul 07 16:44:54.698230 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.697816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj" event={"ID":"3bacf102-dca2-40bd-9a53-a18d36079a93","Type":"ContainerDied","Data":"cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd"}
Jul 07 16:44:54.698230 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.697871    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj" event={"ID":"3bacf102-dca2-40bd-9a53-a18d36079a93","Type":"ContainerDied","Data":"de448cb7408ebf70b244b842a8b948bccccbc4d4012f0992304139ffab831e08"}
Jul 07 16:44:54.698230 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.697894    2563 scope.go:117] "RemoveContainer" containerID="cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd"
Jul 07 16:44:54.706760 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.706742    2563 scope.go:117] "RemoveContainer" containerID="cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd"
Jul 07 16:44:54.707060 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:44:54.707043    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd\": container with ID starting with cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd not found: ID does not exist" containerID="cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd"
Jul 07 16:44:54.707125 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.707068    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd"} err="failed to get container status \"cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd\": rpc error: code = NotFound desc = could not find container \"cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd\": container with ID starting with cc33312bd5252801cfdaf1d780edd4376da52eb30c61042ede3ef3732fd46bdd not found: ID does not exist"
Jul 07 16:44:54.721184 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.721162    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"]
Jul 07 16:44:54.724802 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:54.724775    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3b3b9194-openshift-default-6fccd7f96f-54nmj"]
Jul 07 16:44:55.386504 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:55.386475    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bacf102-dca2-40bd-9a53-a18d36079a93" path="/var/lib/kubelet/pods/3bacf102-dca2-40bd-9a53-a18d36079a93/volumes"
Jul 07 16:44:55.468702 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:55.468678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:59.764382 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:59.764329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:59.871078 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:59.871050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:44:59.987097 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:59.987059    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"]
Jul 07 16:44:59.987452 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:59.987430    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bacf102-dca2-40bd-9a53-a18d36079a93" containerName="istio-proxy"
Jul 07 16:44:59.987575 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:59.987563    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bacf102-dca2-40bd-9a53-a18d36079a93" containerName="istio-proxy"
Jul 07 16:44:59.987694 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:59.987680    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bacf102-dca2-40bd-9a53-a18d36079a93" containerName="istio-proxy"
Jul 07 16:44:59.990598 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:59.990578    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:44:59.996355 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:44:59.996337    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0aef4282-openshift-default-dockercfg-z4hqb\""
Jul 07 16:45:00.011998 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.011967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"]
Jul 07 16:45:00.078514 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.078429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:00.117725 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.117687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-certs\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.117725 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.117718    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgs9w\" (UniqueName: \"kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-kube-api-access-fgs9w\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.118002 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.117748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-token\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.118002 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.117864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-socket\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.118002 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.117890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istiod-ca-cert\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.118002 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.117926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-credential-socket\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.118188 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.118021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-envoy\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.118188 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.118060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-data\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.118188 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.118085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-podinfo\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.210105 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.210049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:00.219244 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-token\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219392 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-socket\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219392 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219282    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istiod-ca-cert\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219392 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219325    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-credential-socket\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219392 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219370    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-envoy\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219599 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-data\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219599 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219415    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-podinfo\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219599 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-certs\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219599 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219508    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgs9w\" (UniqueName: \"kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-kube-api-access-fgs9w\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219783 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219749    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-socket\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219945 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219920    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-credential-socket\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.219987 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.219945    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-certs\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.220092 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.220069    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-data\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.220211 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.220103    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istiod-ca-cert\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.221701 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.221681    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-envoy\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.221987 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.221968    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-podinfo\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.232391 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.232353    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgs9w\" (UniqueName: \"kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-kube-api-access-fgs9w\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.232655 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.232635    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-token\") pod \"e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") " pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.300536 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.300489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:00.461937 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.461909    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"]
Jul 07 16:45:00.463775 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:45:00.463745    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64099c11_2fa9_42a6_aa35_4ab1ee0d7b1f.slice/crio-9c640be121515c7aac6e43b9735bc10306d31df81f2c3ffab5b9e981d97cde55 WatchSource:0}: Error finding container 9c640be121515c7aac6e43b9735bc10306d31df81f2c3ffab5b9e981d97cde55: Status 404 returned error can't find the container with id 9c640be121515c7aac6e43b9735bc10306d31df81f2c3ffab5b9e981d97cde55
Jul 07 16:45:00.465827 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.465798    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:45:00.465906 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.465891    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:45:00.465947 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.465923    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:45:00.731211 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.731173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp" event={"ID":"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f","Type":"ContainerStarted","Data":"885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620"}
Jul 07 16:45:00.731385 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.731224    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp" event={"ID":"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f","Type":"ContainerStarted","Data":"9c640be121515c7aac6e43b9735bc10306d31df81f2c3ffab5b9e981d97cde55"}
Jul 07 16:45:00.784918 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:00.784864    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp" podStartSLOduration=1.7848312320000002 podStartE2EDuration="1.784831232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:44:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:45:00.782755554 +0000 UTC m=+1594.137040801" watchObservedRunningTime="2026-07-07 16:45:00.784831232 +0000 UTC m=+1594.139116479"
Jul 07 16:45:01.250511 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:01.250469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:01.301468 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:01.301442    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:01.302631 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:01.302605    2563 patch_prober.go:28] interesting pod/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Jul 07 16:45:01.302752 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:01.302657    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp" podUID="64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Jul 07 16:45:01.386235 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:01.386205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:01.496691 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:01.496652    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:01.825267 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:01.825219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:02.228288 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:02.228256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:02.308042 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:02.308014    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:02.363397 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:02.363345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:02.740371 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:02.740342    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:02.741339 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:02.741323    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:03.524490 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:03.524455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:05.757879 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:05.757827    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"]
Jul 07 16:45:05.758317 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:05.758059    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp" podUID="64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" containerName="istio-proxy" containerID="cri-o://885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620" gracePeriod=30
Jul 07 16:45:05.990982 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:05.990949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:06.102073 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:06.101974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:07.358760 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:07.358731    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:11.004125 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.004094    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:11.112707 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.112683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-podinfo\") pod \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") "
Jul 07 16:45:11.112901 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.112718    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgs9w\" (UniqueName: \"kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-kube-api-access-fgs9w\") pod \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") "
Jul 07 16:45:11.112901 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.112738    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-envoy\") pod \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") "
Jul 07 16:45:11.112901 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.112786    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-socket\") pod \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") "
Jul 07 16:45:11.112901 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.112859    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-certs\") pod \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") "
Jul 07 16:45:11.112901 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.112884    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-token\") pod \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") "
Jul 07 16:45:11.113151 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.112941    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-data\") pod \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") "
Jul 07 16:45:11.113151 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.112963    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istiod-ca-cert\") pod \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") "
Jul 07 16:45:11.113151 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.112996    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-credential-socket\") pod \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\" (UID: \"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f\") "
Jul 07 16:45:11.113301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.113148    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" (UID: "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:45:11.113301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.113174    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" (UID: "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:45:11.113301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.113246    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:45:11.113301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.113246    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-data" (OuterVolumeSpecName: "istio-data") pod "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" (UID: "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:45:11.113508 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.113437    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" (UID: "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:45:11.113508 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.113482    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" (UID: "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:45:11.115105 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.115076    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" (UID: "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:45:11.115237 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.115119    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-kube-api-access-fgs9w" (OuterVolumeSpecName: "kube-api-access-fgs9w") pod "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" (UID: "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f"). InnerVolumeSpecName "kube-api-access-fgs9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:45:11.115237 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.115131    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" (UID: "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:45:11.115237 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.115203    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" (UID: "64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:45:11.214505 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.214468    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:45:11.214505 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.214501    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:45:11.214505 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.214510    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:45:11.214505 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.214518    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:45:11.214738 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.214526    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:45:11.214738 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.214535    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:45:11.214738 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.214543    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgs9w\" (UniqueName: \"kubernetes.io/projected/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-kube-api-access-fgs9w\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:45:11.214738 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.214551    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:45:11.777877 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.777769    2563 generic.go:356] "Generic (PLEG): container finished" podID="64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" containerID="885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620" exitCode=0
Jul 07 16:45:11.777877 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.777816    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"
Jul 07 16:45:11.777877 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.777866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp" event={"ID":"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f","Type":"ContainerDied","Data":"885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620"}
Jul 07 16:45:11.778152 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.777921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp" event={"ID":"64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f","Type":"ContainerDied","Data":"9c640be121515c7aac6e43b9735bc10306d31df81f2c3ffab5b9e981d97cde55"}
Jul 07 16:45:11.778152 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.777943    2563 scope.go:117] "RemoveContainer" containerID="885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620"
Jul 07 16:45:11.786158 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.786141    2563 scope.go:117] "RemoveContainer" containerID="885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620"
Jul 07 16:45:11.786448 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:45:11.786421    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620\": container with ID starting with 885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620 not found: ID does not exist" containerID="885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620"
Jul 07 16:45:11.786542 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.786455    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620"} err="failed to get container status \"885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620\": rpc error: code = NotFound desc = could not find container \"885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620\": container with ID starting with 885b5cf21c2c7aa355cad4cfae8e6092ac320f00963db8156be201eb51c6e620 not found: ID does not exist"
Jul 07 16:45:11.792000 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.791982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:11.797816 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.797797    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"]
Jul 07 16:45:11.805701 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.805681    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0aef4282-openshift-default-65dd47c667-md5hp"]
Jul 07 16:45:11.865781 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:11.865754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:12.254769 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:12.254724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:12.351635 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:12.351610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:12.451668 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:12.451636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:13.386025 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:13.385991    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" path="/var/lib/kubelet/pods/64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f/volumes"
Jul 07 16:45:13.819885 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:13.819787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:19.912866 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:19.912769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:20.013605 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:20.013570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:20.112901 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:20.112865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:20.215588 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:20.215508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:20.618000 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:20.617973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:46.641069 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:46.641021    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:52.607854 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:52.607799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:52.719849 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:52.719805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:45:52.810293 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:45:52.810261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:08.755069 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:08.755021    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:14.463983 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:14.463949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:15.733908 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:15.733880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:25.218945 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:25.218916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:26.062164 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:26.062134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:31.807532 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:31.807482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:31.882167 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:31.882135    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:31.964243 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:31.964217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:32.064619 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:32.064533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:32.932187 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:32.932140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:33.027538 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:33.027507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:33.127541 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:33.127499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:34.786208 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:34.786176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:40.843858 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:40.843799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:40.917052 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:40.917023    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:41.615351 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:41.615320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:46.564372 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:46.564334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:46.660955 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:46.660927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:47.487748 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:47.487715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:47.996791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:47.996762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:48.095912 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.095883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:48.259497 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.259415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:48.575859 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.575763    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"]
Jul 07 16:46:48.576088 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.576075    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" containerName="istio-proxy"
Jul 07 16:46:48.576131 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.576089    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" containerName="istio-proxy"
Jul 07 16:46:48.576164 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.576143    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="64099c11-2fa9-42a6-aa35-4ab1ee0d7b1f" containerName="istio-proxy"
Jul 07 16:46:48.579045 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.579027    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.582590 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.582559    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-499e5e07-openshift-default-dockercfg-b9mlq\""
Jul 07 16:46:48.596089 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.596069    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"]
Jul 07 16:46:48.598648 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.598630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:48.678046 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.678013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b74t9\" (UniqueName: \"kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-kube-api-access-b74t9\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.678046 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.678048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-credential-socket\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.678301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.678071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21c37cfa-82b7-416f-954b-0f18d0ef3545-istiod-ca-cert\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.678301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.678088    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-certs\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.678301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.678184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-podinfo\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.678301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.678219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-token\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.678301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.678270    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-data\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.678301 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.678296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-envoy\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.678531 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.678344    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-socket\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.779355 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.779317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-podinfo\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.779355 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.779362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-token\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.779612 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.779404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-data\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.779612 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.779427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-envoy\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.779612 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.779466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-socket\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.779983 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.779640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b74t9\" (UniqueName: \"kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-kube-api-access-b74t9\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.779983 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.779973    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-socket\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.780168 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.779879    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-data\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.780168 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.780013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-credential-socket\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.780168 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.780049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21c37cfa-82b7-416f-954b-0f18d0ef3545-istiod-ca-cert\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.780168 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.780075    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-certs\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.780378 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.780314    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-credential-socket\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.780378 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.780371    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-certs\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.780782 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.780761    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21c37cfa-82b7-416f-954b-0f18d0ef3545-istiod-ca-cert\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.781803 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.781776    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-envoy\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.782131 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.782113    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-podinfo\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.793126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.793105    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-token\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.795093 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.795070    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b74t9\" (UniqueName: \"kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-kube-api-access-b74t9\") pod \"e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") " pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:48.889069 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:48.889036    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:49.026416 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:49.026377    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"]
Jul 07 16:46:49.028978 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:46:49.028954    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c37cfa_82b7_416f_954b_0f18d0ef3545.slice/crio-b4ee8ff7b032ee14e026f26b4e01432381d0c13a902f4f3201dbb3af439e8d9b WatchSource:0}: Error finding container b4ee8ff7b032ee14e026f26b4e01432381d0c13a902f4f3201dbb3af439e8d9b: Status 404 returned error can't find the container with id b4ee8ff7b032ee14e026f26b4e01432381d0c13a902f4f3201dbb3af439e8d9b
Jul 07 16:46:49.031051 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:49.031021    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:46:49.031121 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:49.031084    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:46:49.031121 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:49.031118    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:46:49.163175 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:49.163085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:49.167491 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:49.167456    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" event={"ID":"21c37cfa-82b7-416f-954b-0f18d0ef3545","Type":"ContainerStarted","Data":"db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1"}
Jul 07 16:46:49.167648 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:49.167513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" event={"ID":"21c37cfa-82b7-416f-954b-0f18d0ef3545","Type":"ContainerStarted","Data":"b4ee8ff7b032ee14e026f26b4e01432381d0c13a902f4f3201dbb3af439e8d9b"}
Jul 07 16:46:49.188150 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:49.188085    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" podStartSLOduration=1.188066256 podStartE2EDuration="1.188066256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:46:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:46:49.187292419 +0000 UTC m=+1702.541577670" watchObservedRunningTime="2026-07-07 16:46:49.188066256 +0000 UTC m=+1702.542351506"
Jul 07 16:46:49.889657 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:49.889623    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:50.893993 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:50.893956    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:51.175954 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:51.175864    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:51.176885 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:51.176861    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:46:51.765013 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:51.764979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:51.866338 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:51.866309    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:51.951816 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:51.951787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:52.272544 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:52.272512    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:52.537781 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:52.537697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:52.637461 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:52.637433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:56.228906 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:56.228872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:56.946813 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:56.946772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:57.046801 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:57.046771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:57.409969 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:57.409940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:57.952022 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:57.951966    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:58.052636 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:58.052605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:46:58.153913 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:46:58.153881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:03.076126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:03.076097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:03.178364 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:03.178320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:03.624145 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:03.624070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:04.025228 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:04.025147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:04.204952 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:04.204923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:04.231660 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:04.231631    2563 generic.go:356] "Generic (PLEG): container finished" podID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerID="db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1" exitCode=0
Jul 07 16:47:04.231787 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:04.231682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" event={"ID":"21c37cfa-82b7-416f-954b-0f18d0ef3545","Type":"ContainerDied","Data":"db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1"}
Jul 07 16:47:04.232078 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:04.232061    2563 scope.go:117] "RemoveContainer" containerID="db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1"
Jul 07 16:47:04.233080 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:04.233053    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:47:04.233181 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:04.233156    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:47:04.233222 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:04.233207    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:47:05.240823 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:05.240786    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" event={"ID":"21c37cfa-82b7-416f-954b-0f18d0ef3545","Type":"ContainerStarted","Data":"996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711"}
Jul 07 16:47:05.889785 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:05.889751    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:47:05.891027 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:05.891000    2563 patch_prober.go:28] interesting pod/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 07 16:47:05.891154 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:05.891048    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 07 16:47:06.176316 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:06.176236    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:47:06.889880 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:06.889823    2563 patch_prober.go:28] interesting pod/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 07 16:47:06.890285 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:06.889903    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 07 16:47:07.889995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:07.889958    2563 patch_prober.go:28] interesting pod/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 07 16:47:07.890498 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:07.890019    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 07 16:47:08.889572 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:08.889531    2563 patch_prober.go:28] interesting pod/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 07 16:47:08.889753 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:08.889608    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 07 16:47:09.894240 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:09.894213    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:47:09.895236 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:09.895214    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:47:10.172172 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:10.172095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:10.270940 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:10.270905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:10.425177 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:10.425098    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"]
Jul 07 16:47:10.446131 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:10.446103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:10.679119 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:10.679016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:10.810959 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:10.810920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:10.905987 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:10.905950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:11.007096 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:11.007002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:11.270014 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:11.269921    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy" containerID="cri-o://996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711" gracePeriod=30
Jul 07 16:47:16.524397 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.524369    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:47:16.601199 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601111    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-token\") pod \"21c37cfa-82b7-416f-954b-0f18d0ef3545\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") "
Jul 07 16:47:16.601199 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601177    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-envoy\") pod \"21c37cfa-82b7-416f-954b-0f18d0ef3545\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") "
Jul 07 16:47:16.601417 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601220    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-credential-socket\") pod \"21c37cfa-82b7-416f-954b-0f18d0ef3545\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") "
Jul 07 16:47:16.601417 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601248    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-podinfo\") pod \"21c37cfa-82b7-416f-954b-0f18d0ef3545\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") "
Jul 07 16:47:16.601417 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601265    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-certs\") pod \"21c37cfa-82b7-416f-954b-0f18d0ef3545\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") "
Jul 07 16:47:16.601417 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601287    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-socket\") pod \"21c37cfa-82b7-416f-954b-0f18d0ef3545\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") "
Jul 07 16:47:16.601417 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601350    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b74t9\" (UniqueName: \"kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-kube-api-access-b74t9\") pod \"21c37cfa-82b7-416f-954b-0f18d0ef3545\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") "
Jul 07 16:47:16.601417 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601380    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21c37cfa-82b7-416f-954b-0f18d0ef3545-istiod-ca-cert\") pod \"21c37cfa-82b7-416f-954b-0f18d0ef3545\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") "
Jul 07 16:47:16.601417 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601403    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-data\") pod \"21c37cfa-82b7-416f-954b-0f18d0ef3545\" (UID: \"21c37cfa-82b7-416f-954b-0f18d0ef3545\") "
Jul 07 16:47:16.601769 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601581    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "21c37cfa-82b7-416f-954b-0f18d0ef3545" (UID: "21c37cfa-82b7-416f-954b-0f18d0ef3545"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:47:16.601769 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601600    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "21c37cfa-82b7-416f-954b-0f18d0ef3545" (UID: "21c37cfa-82b7-416f-954b-0f18d0ef3545"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:47:16.601908 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601829    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "21c37cfa-82b7-416f-954b-0f18d0ef3545" (UID: "21c37cfa-82b7-416f-954b-0f18d0ef3545"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:47:16.601965 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.601939    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21c37cfa-82b7-416f-954b-0f18d0ef3545-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "21c37cfa-82b7-416f-954b-0f18d0ef3545" (UID: "21c37cfa-82b7-416f-954b-0f18d0ef3545"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:47:16.602663 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.602638    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-data" (OuterVolumeSpecName: "istio-data") pod "21c37cfa-82b7-416f-954b-0f18d0ef3545" (UID: "21c37cfa-82b7-416f-954b-0f18d0ef3545"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:47:16.603418 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.603393    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "21c37cfa-82b7-416f-954b-0f18d0ef3545" (UID: "21c37cfa-82b7-416f-954b-0f18d0ef3545"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:47:16.603555 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.603540    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "21c37cfa-82b7-416f-954b-0f18d0ef3545" (UID: "21c37cfa-82b7-416f-954b-0f18d0ef3545"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:47:16.603767 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.603753    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-token" (OuterVolumeSpecName: "istio-token") pod "21c37cfa-82b7-416f-954b-0f18d0ef3545" (UID: "21c37cfa-82b7-416f-954b-0f18d0ef3545"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:47:16.603813 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.603778    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-kube-api-access-b74t9" (OuterVolumeSpecName: "kube-api-access-b74t9") pod "21c37cfa-82b7-416f-954b-0f18d0ef3545" (UID: "21c37cfa-82b7-416f-954b-0f18d0ef3545"). InnerVolumeSpecName "kube-api-access-b74t9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:47:16.702750 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.702713    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:47:16.702750 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.702745    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:47:16.702750 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.702758    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:47:16.703005 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.702769    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:47:16.703005 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.702778    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b74t9\" (UniqueName: \"kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-kube-api-access-b74t9\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:47:16.703005 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.702787    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21c37cfa-82b7-416f-954b-0f18d0ef3545-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:47:16.703005 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.702796    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:47:16.703005 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.702804    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:47:16.703005 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:16.702811    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21c37cfa-82b7-416f-954b-0f18d0ef3545-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:47:17.028142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.028105    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:17.140030 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.139997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:17.253957 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.253927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:17.297277 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.297178    2563 generic.go:356] "Generic (PLEG): container finished" podID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerID="996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711" exitCode=0
Jul 07 16:47:17.297277 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.297233    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"
Jul 07 16:47:17.297277 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.297252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" event={"ID":"21c37cfa-82b7-416f-954b-0f18d0ef3545","Type":"ContainerDied","Data":"996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711"}
Jul 07 16:47:17.297547 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.297323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk" event={"ID":"21c37cfa-82b7-416f-954b-0f18d0ef3545","Type":"ContainerDied","Data":"b4ee8ff7b032ee14e026f26b4e01432381d0c13a902f4f3201dbb3af439e8d9b"}
Jul 07 16:47:17.297547 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.297355    2563 scope.go:117] "RemoveContainer" containerID="996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711"
Jul 07 16:47:17.306015 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.306001    2563 scope.go:117] "RemoveContainer" containerID="db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1"
Jul 07 16:47:17.313362 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.313346    2563 scope.go:117] "RemoveContainer" containerID="996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711"
Jul 07 16:47:17.313638 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:47:17.313617    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711\": container with ID starting with 996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711 not found: ID does not exist" containerID="996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711"
Jul 07 16:47:17.313685 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.313646    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711"} err="failed to get container status \"996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711\": rpc error: code = NotFound desc = could not find container \"996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711\": container with ID starting with 996027c7d868ad4a64c94f66e6d4dca1b8a0df94bbc77300cfa3d6e9a6c88711 not found: ID does not exist"
Jul 07 16:47:17.313685 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.313664    2563 scope.go:117] "RemoveContainer" containerID="db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1"
Jul 07 16:47:17.313904 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:47:17.313886    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1\": container with ID starting with db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1 not found: ID does not exist" containerID="db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1"
Jul 07 16:47:17.313969 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.313913    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1"} err="failed to get container status \"db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1\": rpc error: code = NotFound desc = could not find container \"db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1\": container with ID starting with db1eea8db6ed145892de7fd81b892797797ee0ba02c296b50e008b9f08dcc6b1 not found: ID does not exist"
Jul 07 16:47:17.320666 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.320639    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"]
Jul 07 16:47:17.325589 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.325570    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-499e5e07-openshift-default-698d9645c9-8kntk"]
Jul 07 16:47:17.386468 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.386435    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" path="/var/lib/kubelet/pods/21c37cfa-82b7-416f-954b-0f18d0ef3545/volumes"
Jul 07 16:47:17.391542 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:17.391506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:23.032682 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:23.032633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:23.099086 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:23.099056    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:29.898467 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:29.898424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:30.187443 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.187355    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"]
Jul 07 16:47:30.187735 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.187717    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy"
Jul 07 16:47:30.187814 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.187738    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy"
Jul 07 16:47:30.187890 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.187828    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy"
Jul 07 16:47:30.190659 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.190638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.193477 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.193455    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-15de1b1f-openshift-default-dockercfg-9bp2t\""
Jul 07 16:47:30.203240 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.203218    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"]
Jul 07 16:47:30.220788 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.220755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:30.314399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.314362    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-credential-socket\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.314399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.314402    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j72rz\" (UniqueName: \"kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-kube-api-access-j72rz\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.314603 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.314432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-data\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.314603 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.314455    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-token\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.314603 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.314536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-podinfo\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.314603 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.314578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-envoy\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.314737 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.314612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-socket\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.314737 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.314651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac19430e-a2df-49ea-8d49-55f97112dc53-istiod-ca-cert\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.314737 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.314696    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-certs\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.387807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.387769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:30.415650 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.415615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-data\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.415650 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.415647    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-token\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.415924 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.415683    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-podinfo\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.415924 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.415710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-envoy\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.415924 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.415728    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-socket\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.415924 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.415759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac19430e-a2df-49ea-8d49-55f97112dc53-istiod-ca-cert\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.415924 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.415782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-certs\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.415924 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.415811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-credential-socket\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.416228 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.416137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j72rz\" (UniqueName: \"kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-kube-api-access-j72rz\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.416228 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.416161    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-data\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.416228 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.416201    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-socket\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.416388 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.416267    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-certs\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.416388 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.416318    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-credential-socket\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.416760 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.416737    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac19430e-a2df-49ea-8d49-55f97112dc53-istiod-ca-cert\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.418206 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.418185    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-envoy\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.418475 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.418457    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-podinfo\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.428113 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.428090    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-token\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.428211 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.428197    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j72rz\" (UniqueName: \"kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-kube-api-access-j72rz\") pod \"e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") " pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.501474 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.501396    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:30.646201 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.646177    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"]
Jul 07 16:47:30.649036 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:47:30.649004    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac19430e_a2df_49ea_8d49_55f97112dc53.slice/crio-77150c80848a1144d022abc8a52f07c930059ea4780f6591a17b695ba6dc802f WatchSource:0}: Error finding container 77150c80848a1144d022abc8a52f07c930059ea4780f6591a17b695ba6dc802f: Status 404 returned error can't find the container with id 77150c80848a1144d022abc8a52f07c930059ea4780f6591a17b695ba6dc802f
Jul 07 16:47:30.651370 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.651324    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:47:30.651478 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.651425    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:47:30.651537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:30.651474    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:47:31.356757 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:31.356721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" event={"ID":"ac19430e-a2df-49ea-8d49-55f97112dc53","Type":"ContainerStarted","Data":"fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f"}
Jul 07 16:47:31.357172 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:31.356797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" event={"ID":"ac19430e-a2df-49ea-8d49-55f97112dc53","Type":"ContainerStarted","Data":"77150c80848a1144d022abc8a52f07c930059ea4780f6591a17b695ba6dc802f"}
Jul 07 16:47:31.379943 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:31.379899    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" podStartSLOduration=1.379884817 podStartE2EDuration="1.379884817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:31.378191549 +0000 UTC m=+1744.732476796" watchObservedRunningTime="2026-07-07 16:47:31.379884817 +0000 UTC m=+1744.734170062"
Jul 07 16:47:31.502655 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:31.502626    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:31.507254 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:31.507228    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:32.361453 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:32.361418    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:32.362306 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:32.362286    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:33.283757 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:33.283724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:33.368316 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:33.368264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:33.501956 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:33.501926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:33.655736 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:33.655706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:33.841972 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:33.841942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:33.944890 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:33.944819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:37.778520 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:37.778488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:46.418695 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:46.418661    2563 generic.go:356] "Generic (PLEG): container finished" podID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerID="fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f" exitCode=0
Jul 07 16:47:46.419166 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:46.418718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" event={"ID":"ac19430e-a2df-49ea-8d49-55f97112dc53","Type":"ContainerDied","Data":"fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f"}
Jul 07 16:47:46.419166 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:46.419074    2563 scope.go:117] "RemoveContainer" containerID="fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f"
Jul 07 16:47:46.420039 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:46.420009    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:47:46.420149 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:46.420087    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:47:46.420212 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:46.420147    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:47:47.361791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:47.361758    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:47.424399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:47.424366    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" event={"ID":"ac19430e-a2df-49ea-8d49-55f97112dc53","Type":"ContainerStarted","Data":"58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3"}
Jul 07 16:47:47.502021 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:47.501994    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:47.502933 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:47.502909    2563 patch_prober.go:28] interesting pod/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 07 16:47:47.503062 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:47.502953    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 07 16:47:47.590176 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:47.590146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:47.691217 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:47.691134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:48.502480 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.502443    2563 patch_prober.go:28] interesting pod/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 07 16:47:48.502894 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.502503    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 07 16:47:48.861214 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.861178    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"]
Jul 07 16:47:48.861749 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.861727    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy"
Jul 07 16:47:48.861793 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.861753    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy"
Jul 07 16:47:48.861899 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.861886    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c37cfa-82b7-416f-954b-0f18d0ef3545" containerName="istio-proxy"
Jul 07 16:47:48.865784 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.865767    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:48.868968 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.868949    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-15de1b1f\"/\"e2e-lifecycle-model-15de1b1f-kserve-self-signed-certs\""
Jul 07 16:47:48.870128 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.870112    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-15de1b1f\"/\"kube-root-ca.crt\""
Jul 07 16:47:48.870238 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.870180    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-15de1b1f\"/\"openshift-service-ca.crt\""
Jul 07 16:47:48.870444 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.870205    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-15de1b1f\"/\"default-dockercfg-jnhrt\""
Jul 07 16:47:48.874919 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.874895    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"]
Jul 07 16:47:48.891967 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.891947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:48.972806 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.972772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-dshm\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:48.972987 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.972816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-home\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:48.972987 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.972859    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tls-certs\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:48.972987 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.972896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-model-cache\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:48.972987 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.972918    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9pcf\" (UniqueName: \"kubernetes.io/projected/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-kube-api-access-p9pcf\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:48.972987 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:48.972977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tmp-dir\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.074340 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.074305    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-dshm\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.074519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.074351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-home\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.074519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.074381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tls-certs\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.074519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.074427    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-model-cache\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.074519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.074459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9pcf\" (UniqueName: \"kubernetes.io/projected/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-kube-api-access-p9pcf\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.074519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.074498    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tmp-dir\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.074875 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.074822    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-model-cache\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.075052 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.074913    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-home\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.075144 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.074913    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tmp-dir\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.076606 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.076584    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-dshm\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.076934 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.076913    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tls-certs\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.084160 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.084135    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9pcf\" (UniqueName: \"kubernetes.io/projected/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-kube-api-access-p9pcf\") pod \"e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") " pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.176100 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.175908    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:49.355898 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.355870    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"]
Jul 07 16:47:49.356257 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:47:49.356231    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ce7c94f_5c65_4fff_8fb9_0e713ddb4d41.slice/crio-4b8da4e6be601a3e1f5f863bcb1007824ddd19e30ec31352c8154455c740c5a5 WatchSource:0}: Error finding container 4b8da4e6be601a3e1f5f863bcb1007824ddd19e30ec31352c8154455c740c5a5: Status 404 returned error can't find the container with id 4b8da4e6be601a3e1f5f863bcb1007824ddd19e30ec31352c8154455c740c5a5
Jul 07 16:47:49.458576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.458483    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6" event={"ID":"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41","Type":"ContainerStarted","Data":"e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8"}
Jul 07 16:47:49.458576 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.458533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6" event={"ID":"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41","Type":"ContainerStarted","Data":"4b8da4e6be601a3e1f5f863bcb1007824ddd19e30ec31352c8154455c740c5a5"}
Jul 07 16:47:49.481044 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.481000    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6" podStartSLOduration=1.4809846819999999 podStartE2EDuration="1.480984682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:47:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:47:49.479670339 +0000 UTC m=+1762.833955598" watchObservedRunningTime="2026-07-07 16:47:49.480984682 +0000 UTC m=+1762.835269962"
Jul 07 16:47:49.502609 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.502574    2563 patch_prober.go:28] interesting pod/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 07 16:47:49.502970 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:49.502624    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 07 16:47:50.502493 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:50.502456    2563 patch_prober.go:28] interesting pod/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Jul 07 16:47:50.502695 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:50.502525    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Jul 07 16:47:51.505884 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:51.505848    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:51.506298 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:51.506117    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:51.506723 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:51.506706    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:47:54.593375 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:54.593339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:54.700491 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:54.700464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:47:59.176604 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:59.176554    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:59.176604 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:59.176617    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:59.188818 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:59.188797    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:47:59.508934 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:47:59.508853    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:48:06.421851 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:06.421807    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:10.182798 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:10.182765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:10.543655 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:10.543549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:16.244293 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:16.244262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:21.224608 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:21.224526    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"]
Jul 07 16:48:21.272054 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:21.272022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:36.244604 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.244540    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6" podUID="9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" containerName="main" containerID="cri-o://e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8" gracePeriod=45
Jul 07 16:48:36.488658 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.488635    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:48:36.540049 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.539975    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-home\") pod \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") "
Jul 07 16:48:36.540049 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540018    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-model-cache\") pod \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") "
Jul 07 16:48:36.540249 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540059    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9pcf\" (UniqueName: \"kubernetes.io/projected/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-kube-api-access-p9pcf\") pod \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") "
Jul 07 16:48:36.540249 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540104    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tmp-dir\") pod \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") "
Jul 07 16:48:36.540249 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540148    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tls-certs\") pod \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") "
Jul 07 16:48:36.540249 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540188    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-dshm\") pod \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\" (UID: \"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41\") "
Jul 07 16:48:36.540519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540309    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-home" (OuterVolumeSpecName: "home") pod "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" (UID: "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:48:36.540519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540322    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-model-cache" (OuterVolumeSpecName: "model-cache") pod "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" (UID: "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:48:36.540519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540428    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" (UID: "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:48:36.540519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540500    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tmp-dir\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:48:36.540519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540520    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-home\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:48:36.540763 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.540533    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-model-cache\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:48:36.542443 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.542413    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-dshm" (OuterVolumeSpecName: "dshm") pod "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" (UID: "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:48:36.542559 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.542468    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-kube-api-access-p9pcf" (OuterVolumeSpecName: "kube-api-access-p9pcf") pod "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" (UID: "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41"). InnerVolumeSpecName "kube-api-access-p9pcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:48:36.542559 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.542545    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" (UID: "9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:48:36.641277 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.641249    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:48:36.641277 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.641273    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-dshm\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:48:36.641277 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.641283    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9pcf\" (UniqueName: \"kubernetes.io/projected/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41-kube-api-access-p9pcf\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:48:36.645901 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.645869    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" containerID="e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8" exitCode=0
Jul 07 16:48:36.646039 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.645930    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"
Jul 07 16:48:36.646039 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.645948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6" event={"ID":"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41","Type":"ContainerDied","Data":"e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8"}
Jul 07 16:48:36.646039 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.645991    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6" event={"ID":"9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41","Type":"ContainerDied","Data":"4b8da4e6be601a3e1f5f863bcb1007824ddd19e30ec31352c8154455c740c5a5"}
Jul 07 16:48:36.646039 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.646008    2563 scope.go:117] "RemoveContainer" containerID="e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8"
Jul 07 16:48:36.657033 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.657013    2563 scope.go:117] "RemoveContainer" containerID="e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8"
Jul 07 16:48:36.657293 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:48:36.657274    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8\": container with ID starting with e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8 not found: ID does not exist" containerID="e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8"
Jul 07 16:48:36.657357 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.657300    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8"} err="failed to get container status \"e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8\": rpc error: code = NotFound desc = could not find container \"e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8\": container with ID starting with e58d1256a356bea86819bba899f3066d5dabf35255c6304ae11e7d3477a099f8 not found: ID does not exist"
Jul 07 16:48:36.670098 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.670076    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"]
Jul 07 16:48:36.674587 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:36.674566    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-15de1b1f/e2e-lifecycle-model-15de1b1f-kserve-649dc7c7b7-95kc6"]
Jul 07 16:48:37.386571 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:37.386534    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" path="/var/lib/kubelet/pods/9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41/volumes"
Jul 07 16:48:57.685397 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:57.685366    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:48:58.742466 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:48:58.742424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:04.803198 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:04.803166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:04.907391 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:04.907361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:05.086914 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:05.086795    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"]
Jul 07 16:49:05.087049 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:05.087013    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy" containerID="cri-o://58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3" gracePeriod=30
Jul 07 16:49:05.108854 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:05.108819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:05.359925 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:05.359900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:06.456445 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:06.456404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:06.508360 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:06.508328    2563 patch_prober.go:28] interesting pod/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 16:49:06.508519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:06.508387    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 16:49:06.555014 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:06.554983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:06.655573 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:06.655537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:07.535336 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:07.535306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:07.625559 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:07.625531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:09.101400 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:09.101371    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:10.341362 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.341333    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:49:10.510858 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.510804    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-certs\") pod \"ac19430e-a2df-49ea-8d49-55f97112dc53\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") "
Jul 07 16:49:10.511054 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.510883    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-credential-socket\") pod \"ac19430e-a2df-49ea-8d49-55f97112dc53\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") "
Jul 07 16:49:10.511054 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.510915    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-token\") pod \"ac19430e-a2df-49ea-8d49-55f97112dc53\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") "
Jul 07 16:49:10.511054 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.510935    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-envoy\") pod \"ac19430e-a2df-49ea-8d49-55f97112dc53\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") "
Jul 07 16:49:10.511054 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.510971    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j72rz\" (UniqueName: \"kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-kube-api-access-j72rz\") pod \"ac19430e-a2df-49ea-8d49-55f97112dc53\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") "
Jul 07 16:49:10.511054 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.510992    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-podinfo\") pod \"ac19430e-a2df-49ea-8d49-55f97112dc53\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") "
Jul 07 16:49:10.511054 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.511035    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-data\") pod \"ac19430e-a2df-49ea-8d49-55f97112dc53\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") "
Jul 07 16:49:10.511389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.511060    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac19430e-a2df-49ea-8d49-55f97112dc53-istiod-ca-cert\") pod \"ac19430e-a2df-49ea-8d49-55f97112dc53\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") "
Jul 07 16:49:10.511389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.511099    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-socket\") pod \"ac19430e-a2df-49ea-8d49-55f97112dc53\" (UID: \"ac19430e-a2df-49ea-8d49-55f97112dc53\") "
Jul 07 16:49:10.511389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.511134    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac19430e-a2df-49ea-8d49-55f97112dc53" (UID: "ac19430e-a2df-49ea-8d49-55f97112dc53"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:49:10.511389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.511142    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac19430e-a2df-49ea-8d49-55f97112dc53" (UID: "ac19430e-a2df-49ea-8d49-55f97112dc53"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:49:10.511389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.511354    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:49:10.511389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.511380    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:49:10.511683 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.511461    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac19430e-a2df-49ea-8d49-55f97112dc53-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac19430e-a2df-49ea-8d49-55f97112dc53" (UID: "ac19430e-a2df-49ea-8d49-55f97112dc53"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:49:10.511740 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.511678    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac19430e-a2df-49ea-8d49-55f97112dc53" (UID: "ac19430e-a2df-49ea-8d49-55f97112dc53"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:49:10.511975 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.511954    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac19430e-a2df-49ea-8d49-55f97112dc53" (UID: "ac19430e-a2df-49ea-8d49-55f97112dc53"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:49:10.513284 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.513257    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac19430e-a2df-49ea-8d49-55f97112dc53" (UID: "ac19430e-a2df-49ea-8d49-55f97112dc53"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:49:10.513390 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.513287    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac19430e-a2df-49ea-8d49-55f97112dc53" (UID: "ac19430e-a2df-49ea-8d49-55f97112dc53"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:49:10.513513 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.513489    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac19430e-a2df-49ea-8d49-55f97112dc53" (UID: "ac19430e-a2df-49ea-8d49-55f97112dc53"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:49:10.513595 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.513568    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-kube-api-access-j72rz" (OuterVolumeSpecName: "kube-api-access-j72rz") pod "ac19430e-a2df-49ea-8d49-55f97112dc53" (UID: "ac19430e-a2df-49ea-8d49-55f97112dc53"). InnerVolumeSpecName "kube-api-access-j72rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:49:10.612098 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.612059    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j72rz\" (UniqueName: \"kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-kube-api-access-j72rz\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:49:10.612098 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.612087    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:49:10.612098 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.612097    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:49:10.612098 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.612109    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac19430e-a2df-49ea-8d49-55f97112dc53-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:49:10.612451 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.612117    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:49:10.612451 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.612125    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:49:10.612451 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.612133    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac19430e-a2df-49ea-8d49-55f97112dc53-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:49:10.802692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.802605    2563 generic.go:356] "Generic (PLEG): container finished" podID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerID="58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3" exitCode=0
Jul 07 16:49:10.802692 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.802665    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"
Jul 07 16:49:10.802942 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.802697    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" event={"ID":"ac19430e-a2df-49ea-8d49-55f97112dc53","Type":"ContainerDied","Data":"58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3"}
Jul 07 16:49:10.802942 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.802789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz" event={"ID":"ac19430e-a2df-49ea-8d49-55f97112dc53","Type":"ContainerDied","Data":"77150c80848a1144d022abc8a52f07c930059ea4780f6591a17b695ba6dc802f"}
Jul 07 16:49:10.802942 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.802820    2563 scope.go:117] "RemoveContainer" containerID="58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3"
Jul 07 16:49:10.812158 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.812143    2563 scope.go:117] "RemoveContainer" containerID="fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f"
Jul 07 16:49:10.819923 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.819907    2563 scope.go:117] "RemoveContainer" containerID="58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3"
Jul 07 16:49:10.820177 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:49:10.820156    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3\": container with ID starting with 58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3 not found: ID does not exist" containerID="58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3"
Jul 07 16:49:10.820232 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.820185    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3"} err="failed to get container status \"58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3\": rpc error: code = NotFound desc = could not find container \"58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3\": container with ID starting with 58c0ec42cd508b82cb633b04aa97ccd67e37cc57e40537c5106292a29bd1a5d3 not found: ID does not exist"
Jul 07 16:49:10.820232 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.820203    2563 scope.go:117] "RemoveContainer" containerID="fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f"
Jul 07 16:49:10.820420 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:49:10.820400    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f\": container with ID starting with fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f not found: ID does not exist" containerID="fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f"
Jul 07 16:49:10.820474 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.820429    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f"} err="failed to get container status \"fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f\": rpc error: code = NotFound desc = could not find container \"fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f\": container with ID starting with fc3ca2bc4079187ff70c61ba780faa431ed3f3af5d3fa5e02d207266f3f7e31f not found: ID does not exist"
Jul 07 16:49:10.826926 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.826906    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"]
Jul 07 16:49:10.830769 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:10.830748    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-15de1b1f-openshift-default-56fcf46b55-2b7bz"]
Jul 07 16:49:11.386366 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:11.386334    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" path="/var/lib/kubelet/pods/ac19430e-a2df-49ea-8d49-55f97112dc53/volumes"
Jul 07 16:49:15.667976 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:15.667948    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:15.773041 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:15.773011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:16.393966 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:16.393933    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:22.619183 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:22.619145    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:22.766564 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:22.766537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:22.864037 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:22.864003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:33.461486 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:33.461444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:33.876665 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:33.876635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:49:54.844817 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:49:54.844706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:00.981367 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:00.981337    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:01.083005 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.082970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:01.373106 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.373080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:01.641188 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.641113    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"]
Jul 07 16:50:01.641544 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.641530    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" containerName="main"
Jul 07 16:50:01.641593 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.641548    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" containerName="main"
Jul 07 16:50:01.641593 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.641562    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy"
Jul 07 16:50:01.641593 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.641571    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy"
Jul 07 16:50:01.641593 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.641582    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy"
Jul 07 16:50:01.641593 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.641590    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy"
Jul 07 16:50:01.641746 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.641674    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy"
Jul 07 16:50:01.641746 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.641683    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac19430e-a2df-49ea-8d49-55f97112dc53" containerName="istio-proxy"
Jul 07 16:50:01.641746 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.641692    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ce7c94f-5c65-4fff-8fb9-0e713ddb4d41" containerName="main"
Jul 07 16:50:01.644450 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.644432    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.650289 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.650265    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-592405-openshift-default-dockercfg-9t56g\""
Jul 07 16:50:01.661685 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.661660    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"]
Jul 07 16:50:01.695812 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.695780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:01.723296 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.723251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e78440aa-b338-4321-a8b8-31b234c47687-istiod-ca-cert\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.723480 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.723312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv2xk\" (UniqueName: \"kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-kube-api-access-cv2xk\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.723480 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.723401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-data\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.723480 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.723436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-credential-socket\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.723480 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.723458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e78440aa-b338-4321-a8b8-31b234c47687-istio-podinfo\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.723636 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.723489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-socket\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.723636 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.723548    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-certs\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.723636 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.723582    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-envoy\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.723636 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.723605    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-istio-token\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.824480 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.824440    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-data\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.824480 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.824484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-credential-socket\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.824735 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.824503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e78440aa-b338-4321-a8b8-31b234c47687-istio-podinfo\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.824735 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.824557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-socket\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.824735 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.824607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-certs\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.824735 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.824638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-envoy\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.824735 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.824657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-istio-token\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.824735 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.824697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e78440aa-b338-4321-a8b8-31b234c47687-istiod-ca-cert\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.825073 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.824738    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv2xk\" (UniqueName: \"kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-kube-api-access-cv2xk\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.825073 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.824947    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-data\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.825182 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.825091    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-certs\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.825238 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.825204    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-socket\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.825332 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.825310    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-credential-socket\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.825612 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.825590    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e78440aa-b338-4321-a8b8-31b234c47687-istiod-ca-cert\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.827014 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.826984    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-envoy\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.827246 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.827226    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e78440aa-b338-4321-a8b8-31b234c47687-istio-podinfo\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.836144 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.836119    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-istio-token\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.836999 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.836978    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv2xk\" (UniqueName: \"kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-kube-api-access-cv2xk\") pod \"e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") " pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:01.934794 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.934702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:01.955725 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:01.955694    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:02.103903 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:02.103875    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"]
Jul 07 16:50:02.105524 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:50:02.105496    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode78440aa_b338_4321_a8b8_31b234c47687.slice/crio-c712c5f6558fea4042a4171f5a18c40ad313240e9832d3ff5a8b774e9dbcd143 WatchSource:0}: Error finding container c712c5f6558fea4042a4171f5a18c40ad313240e9832d3ff5a8b774e9dbcd143: Status 404 returned error can't find the container with id c712c5f6558fea4042a4171f5a18c40ad313240e9832d3ff5a8b774e9dbcd143
Jul 07 16:50:02.107757 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:02.107726    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:02.107823 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:02.107792    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:02.107887 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:02.107820    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:03.018003 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:03.017968    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" event={"ID":"e78440aa-b338-4321-a8b8-31b234c47687","Type":"ContainerStarted","Data":"9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0"}
Jul 07 16:50:03.018206 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:03.018021    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" event={"ID":"e78440aa-b338-4321-a8b8-31b234c47687","Type":"ContainerStarted","Data":"c712c5f6558fea4042a4171f5a18c40ad313240e9832d3ff5a8b774e9dbcd143"}
Jul 07 16:50:03.047264 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:03.047214    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" podStartSLOduration=2.047198759 podStartE2EDuration="2.047198759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:50:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:50:03.046093113 +0000 UTC m=+1896.400378360" watchObservedRunningTime="2026-07-07 16:50:03.047198759 +0000 UTC m=+1896.401484006"
Jul 07 16:50:03.956275 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:03.956242    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:03.961030 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:03.961005    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:04.022201 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:04.022172    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:04.022997 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:04.022978    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:05.277339 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:05.277303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:05.410001 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:05.409972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:05.686281 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:05.686241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:06.440220 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:06.440185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:06.647083 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:06.647054    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:09.514690 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:09.514644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:09.853406 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:09.853298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:10.151411 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.151375    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"]
Jul 07 16:50:10.154849 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.154824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.158000 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.157977    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-cfae17-openshift-default-dockercfg-6c2v6\""
Jul 07 16:50:10.169666 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.169640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"]
Jul 07 16:50:10.189243 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.189212    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:10.295715 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.295684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-credential-socket\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.295909 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.295729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-data\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.295909 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.295750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-envoy\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.295909 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.295789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mjkd\" (UniqueName: \"kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-kube-api-access-9mjkd\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.295909 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.295833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-socket\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.295909 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.295894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-podinfo\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.296087 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.295927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istiod-ca-cert\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.296087 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.296018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-token\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.296087 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.296048    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-certs\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.396399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.396363    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-token\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.396399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.396403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-certs\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.396649 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.396512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-credential-socket\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.396649 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.396563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-data\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.396649 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.396589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-envoy\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.396649 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.396615    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mjkd\" (UniqueName: \"kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-kube-api-access-9mjkd\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.396649 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.396630    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-socket\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.396929 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.396659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-podinfo\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.396929 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.396702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istiod-ca-cert\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.396929 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.396794    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-certs\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.397078 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.397062    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-data\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.397140 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.397062    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-credential-socket\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.397197 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.397180    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-socket\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.397497 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.397478    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istiod-ca-cert\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.398979 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.398961    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-envoy\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.399290 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.399267    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-podinfo\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.407455 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.407390    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-token\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.408069 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.408050    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mjkd\" (UniqueName: \"kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-kube-api-access-9mjkd\") pod \"e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") " pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.422515 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.422494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:10.467302 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.467275    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:10.602179 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.602154    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"]
Jul 07 16:50:10.604267 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:50:10.604241    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00e0ef2_2aa3_4185_819e_d8d90b5dbea4.slice/crio-bc349eda57290b84d2980074b5cc5128c4ed72c51952a0d4a19739b99b2f463d WatchSource:0}: Error finding container bc349eda57290b84d2980074b5cc5128c4ed72c51952a0d4a19739b99b2f463d: Status 404 returned error can't find the container with id bc349eda57290b84d2980074b5cc5128c4ed72c51952a0d4a19739b99b2f463d
Jul 07 16:50:10.606306 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.606278    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:10.606365 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.606340    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:10.606410 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:10.606367    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:11.053656 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:11.053570    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" event={"ID":"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4","Type":"ContainerStarted","Data":"6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38"}
Jul 07 16:50:11.053656 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:11.053634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" event={"ID":"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4","Type":"ContainerStarted","Data":"bc349eda57290b84d2980074b5cc5128c4ed72c51952a0d4a19739b99b2f463d"}
Jul 07 16:50:11.088116 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:11.088059    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" podStartSLOduration=1.088040013 podStartE2EDuration="1.088040013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:50:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:50:11.086037107 +0000 UTC m=+1904.440322354" watchObservedRunningTime="2026-07-07 16:50:11.088040013 +0000 UTC m=+1904.442325262"
Jul 07 16:50:11.467693 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:11.467657    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:11.472481 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:11.472460    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:12.058087 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:12.058055    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:12.059044 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:12.059024    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:13.117698 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:13.117671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:13.223442 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:13.223404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:13.334662 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:13.334623    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:13.681223 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:13.681188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:14.097508 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:14.097425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:14.227094 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:14.227060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:17.535392 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:17.535352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:20.064015 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:20.063977    2563 patch_prober.go:28] interesting pod/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 16:50:20.064597 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:20.064055    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 16:50:21.099716 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:21.099680    2563 generic.go:356] "Generic (PLEG): container finished" podID="e78440aa-b338-4321-a8b8-31b234c47687" containerID="9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0" exitCode=0
Jul 07 16:50:21.100211 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:21.099750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" event={"ID":"e78440aa-b338-4321-a8b8-31b234c47687","Type":"ContainerDied","Data":"9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0"}
Jul 07 16:50:21.100211 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:21.100192    2563 scope.go:117] "RemoveContainer" containerID="9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0"
Jul 07 16:50:21.101277 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:21.101251    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:21.101331 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:21.101317    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:21.101367 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:21.101350    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:22.105626 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:22.105593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" event={"ID":"e78440aa-b338-4321-a8b8-31b234c47687","Type":"ContainerStarted","Data":"21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a"}
Jul 07 16:50:22.957016 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:22.956968    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:22.957367 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:22.957042    2563 patch_prober.go:28] interesting pod/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 07 16:50:22.957591 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:22.957563    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 07 16:50:23.455461 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:23.455384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:23.956369 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:23.956333    2563 patch_prober.go:28] interesting pod/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 07 16:50:23.956555 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:23.956414    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 07 16:50:24.957166 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:24.956793    2563 patch_prober.go:28] interesting pod/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 07 16:50:24.957166 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:24.956885    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 07 16:50:25.956402 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:25.956357    2563 patch_prober.go:28] interesting pod/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Jul 07 16:50:25.956615 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:25.956437    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Jul 07 16:50:26.959322 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:26.959300    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:26.959733 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:26.959562    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:26.960180 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:26.960166    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:50:27.059863 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:27.059807    2563 patch_prober.go:28] interesting pod/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 07 16:50:27.060062 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:27.059873    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 07 16:50:27.130803 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:27.130775    2563 generic.go:356] "Generic (PLEG): container finished" podID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerID="6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38" exitCode=0
Jul 07 16:50:27.130961 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:27.130869    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" event={"ID":"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4","Type":"ContainerDied","Data":"6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38"}
Jul 07 16:50:27.131369 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:27.131352    2563 scope.go:117] "RemoveContainer" containerID="6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38"
Jul 07 16:50:27.132294 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:27.132271    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:27.132361 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:27.132345    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:27.132417 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:27.132402    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:50:28.139881 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:28.139817    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" event={"ID":"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4","Type":"ContainerStarted","Data":"4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859"}
Jul 07 16:50:28.468581 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:28.468489    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:28.468748 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:28.468722    2563 patch_prober.go:28] interesting pod/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 07 16:50:28.468793 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:28.468779    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 07 16:50:28.736224 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:28.736112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:28.837582 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:28.837541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:29.468620 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:29.468587    2563 patch_prober.go:28] interesting pod/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 07 16:50:29.469033 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:29.468636    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 07 16:50:30.467782 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:30.467745    2563 patch_prober.go:28] interesting pod/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 07 16:50:30.468082 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:30.467806    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 07 16:50:31.468058 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:31.468025    2563 patch_prober.go:28] interesting pod/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 07 16:50:31.468455 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:31.468081    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 07 16:50:32.472664 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:32.472636    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:32.473154 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:32.473142    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:32.473785 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:32.473765    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:50:34.905553 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:34.905510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:35.006207 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:35.006181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:55.068257 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.068220    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"]
Jul 07 16:50:55.072072 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.072050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.076055 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.076037    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cfae17\"/\"default-dockercfg-d8n75\""
Jul 07 16:50:55.077356 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.077337    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cfae17\"/\"kube-root-ca.crt\""
Jul 07 16:50:55.077455 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.077424    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cfae17\"/\"test-model-cfae17-kserve-self-signed-certs\""
Jul 07 16:50:55.077520 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.077455    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cfae17\"/\"openshift-service-ca.crt\""
Jul 07 16:50:55.092151 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.092130    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"]
Jul 07 16:50:55.121974 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.121945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:50:55.171877 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.171833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-tmp-dir\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.171997 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.171893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5cv7\" (UniqueName: \"kubernetes.io/projected/b49f8034-e909-451a-a632-e794772bbd6e-kube-api-access-q5cv7\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.171997 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.171981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-home\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.172072 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.172008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b49f8034-e909-451a-a632-e794772bbd6e-tls-certs\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.172072 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.172044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-model-cache\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.172137 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.172074    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-dshm\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.273244 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.273216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-model-cache\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.273399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.273252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-dshm\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.273399 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.273378    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-tmp-dir\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.273478 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.273444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5cv7\" (UniqueName: \"kubernetes.io/projected/b49f8034-e909-451a-a632-e794772bbd6e-kube-api-access-q5cv7\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.273542 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.273527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-home\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.273599 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.273553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b49f8034-e909-451a-a632-e794772bbd6e-tls-certs\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.273700 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.273680    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-model-cache\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.273759 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.273742    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-tmp-dir\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.273853 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.273819    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-home\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.275455 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.275438    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-dshm\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.275855 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.275822    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b49f8034-e909-451a-a632-e794772bbd6e-tls-certs\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.283211 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.283187    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5cv7\" (UniqueName: \"kubernetes.io/projected/b49f8034-e909-451a-a632-e794772bbd6e-kube-api-access-q5cv7\") pod \"test-model-cfae17-kserve-fc7dfd875-n9g9d\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") " pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.380701 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.380670    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:50:55.513289 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:55.513266    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"]
Jul 07 16:50:55.515260 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:50:55.515229    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb49f8034_e909_451a_a632_e794772bbd6e.slice/crio-1cbc24dc7529a72686e464a6860e197930e26c0cfcd7e11532731146c76b7d58 WatchSource:0}: Error finding container 1cbc24dc7529a72686e464a6860e197930e26c0cfcd7e11532731146c76b7d58: Status 404 returned error can't find the container with id 1cbc24dc7529a72686e464a6860e197930e26c0cfcd7e11532731146c76b7d58
Jul 07 16:50:56.262485 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:56.262449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d" event={"ID":"b49f8034-e909-451a-a632-e794772bbd6e","Type":"ContainerStarted","Data":"9a6b40d89d2bdd62d5e2517f2de7d6fa2cf7f72c2e01a616877271a7a9eb445b"}
Jul 07 16:50:56.262912 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:56.262496    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d" event={"ID":"b49f8034-e909-451a-a632-e794772bbd6e","Type":"ContainerStarted","Data":"1cbc24dc7529a72686e464a6860e197930e26c0cfcd7e11532731146c76b7d58"}
Jul 07 16:50:56.283424 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:50:56.283383    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d" podStartSLOduration=1.283369002 podStartE2EDuration="1.283369002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:50:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:50:56.281214248 +0000 UTC m=+1949.635499497" watchObservedRunningTime="2026-07-07 16:50:56.283369002 +0000 UTC m=+1949.637654251"
Jul 07 16:51:05.386636 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:05.386607    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:51:05.387049 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:05.386646    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:51:05.393777 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:05.393755    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:51:06.317478 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:06.317442    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:51:16.175873 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:16.175801    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:17.181897 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:17.181859    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"]
Jul 07 16:51:17.397033 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:17.397001    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:17.855932 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:17.855895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:18.022011 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:18.021982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:18.130787 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:18.130735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:18.317950 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:18.317920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:22.883978 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:22.883905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:51:32.201638 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.201596    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d" podUID="b49f8034-e909-451a-a632-e794772bbd6e" containerName="main" containerID="cri-o://9a6b40d89d2bdd62d5e2517f2de7d6fa2cf7f72c2e01a616877271a7a9eb445b" gracePeriod=45
Jul 07 16:51:32.417304 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.417273    2563 generic.go:356] "Generic (PLEG): container finished" podID="b49f8034-e909-451a-a632-e794772bbd6e" containerID="9a6b40d89d2bdd62d5e2517f2de7d6fa2cf7f72c2e01a616877271a7a9eb445b" exitCode=0
Jul 07 16:51:32.417473 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.417355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d" event={"ID":"b49f8034-e909-451a-a632-e794772bbd6e","Type":"ContainerDied","Data":"9a6b40d89d2bdd62d5e2517f2de7d6fa2cf7f72c2e01a616877271a7a9eb445b"}
Jul 07 16:51:32.443895 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.443874    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:51:32.494087 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494018    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-model-cache\") pod \"b49f8034-e909-451a-a632-e794772bbd6e\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") "
Jul 07 16:51:32.494225 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494103    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q5cv7\" (UniqueName: \"kubernetes.io/projected/b49f8034-e909-451a-a632-e794772bbd6e-kube-api-access-q5cv7\") pod \"b49f8034-e909-451a-a632-e794772bbd6e\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") "
Jul 07 16:51:32.494225 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494129    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-dshm\") pod \"b49f8034-e909-451a-a632-e794772bbd6e\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") "
Jul 07 16:51:32.494225 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494160    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-home\") pod \"b49f8034-e909-451a-a632-e794772bbd6e\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") "
Jul 07 16:51:32.494225 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494190    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-tmp-dir\") pod \"b49f8034-e909-451a-a632-e794772bbd6e\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") "
Jul 07 16:51:32.494225 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494210    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b49f8034-e909-451a-a632-e794772bbd6e-tls-certs\") pod \"b49f8034-e909-451a-a632-e794772bbd6e\" (UID: \"b49f8034-e909-451a-a632-e794772bbd6e\") "
Jul 07 16:51:32.494488 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494267    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-model-cache" (OuterVolumeSpecName: "model-cache") pod "b49f8034-e909-451a-a632-e794772bbd6e" (UID: "b49f8034-e909-451a-a632-e794772bbd6e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:51:32.494488 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494406    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-home" (OuterVolumeSpecName: "home") pod "b49f8034-e909-451a-a632-e794772bbd6e" (UID: "b49f8034-e909-451a-a632-e794772bbd6e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:51:32.494488 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494417    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b49f8034-e909-451a-a632-e794772bbd6e" (UID: "b49f8034-e909-451a-a632-e794772bbd6e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:51:32.494628 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494523    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-model-cache\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:51:32.494628 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494539    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-home\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:51:32.494628 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.494574    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-tmp-dir\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:51:32.496352 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.496325    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-dshm" (OuterVolumeSpecName: "dshm") pod "b49f8034-e909-451a-a632-e794772bbd6e" (UID: "b49f8034-e909-451a-a632-e794772bbd6e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:51:32.496462 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.496357    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b49f8034-e909-451a-a632-e794772bbd6e-kube-api-access-q5cv7" (OuterVolumeSpecName: "kube-api-access-q5cv7") pod "b49f8034-e909-451a-a632-e794772bbd6e" (UID: "b49f8034-e909-451a-a632-e794772bbd6e"). InnerVolumeSpecName "kube-api-access-q5cv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:51:32.496462 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.496364    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b49f8034-e909-451a-a632-e794772bbd6e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b49f8034-e909-451a-a632-e794772bbd6e" (UID: "b49f8034-e909-451a-a632-e794772bbd6e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:51:32.595663 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.595631    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q5cv7\" (UniqueName: \"kubernetes.io/projected/b49f8034-e909-451a-a632-e794772bbd6e-kube-api-access-q5cv7\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:51:32.595799 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.595658    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b49f8034-e909-451a-a632-e794772bbd6e-dshm\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:51:32.595799 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:32.595680    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b49f8034-e909-451a-a632-e794772bbd6e-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:51:33.423405 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:33.423379    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"
Jul 07 16:51:33.423822 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:33.423372    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d" event={"ID":"b49f8034-e909-451a-a632-e794772bbd6e","Type":"ContainerDied","Data":"1cbc24dc7529a72686e464a6860e197930e26c0cfcd7e11532731146c76b7d58"}
Jul 07 16:51:33.423822 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:33.423507    2563 scope.go:117] "RemoveContainer" containerID="9a6b40d89d2bdd62d5e2517f2de7d6fa2cf7f72c2e01a616877271a7a9eb445b"
Jul 07 16:51:33.454551 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:33.454531    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"]
Jul 07 16:51:33.459501 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:33.459480    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-cfae17/test-model-cfae17-kserve-fc7dfd875-n9g9d"]
Jul 07 16:51:35.393481 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:51:35.393438    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b49f8034-e909-451a-a632-e794772bbd6e" path="/var/lib/kubelet/pods/b49f8034-e909-451a-a632-e794772bbd6e/volumes"
Jul 07 16:52:00.209262 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:00.209223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:00.584812 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:00.584730    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"]
Jul 07 16:52:00.584985 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:00.584941    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy" containerID="cri-o://21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a" gracePeriod=30
Jul 07 16:52:00.610628 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:00.610598    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:00.814490 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:00.814458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:01.179747 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:01.179717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:01.555489 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:01.555403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:01.822519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:01.822420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:01.926478 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:01.926439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:02.145918 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:02.145882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:05.832131 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.832105    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:52:05.884939 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.884908    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-certs\") pod \"e78440aa-b338-4321-a8b8-31b234c47687\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") "
Jul 07 16:52:05.884939 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.884939    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e78440aa-b338-4321-a8b8-31b234c47687-istiod-ca-cert\") pod \"e78440aa-b338-4321-a8b8-31b234c47687\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") "
Jul 07 16:52:05.885135 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.884972    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cv2xk\" (UniqueName: \"kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-kube-api-access-cv2xk\") pod \"e78440aa-b338-4321-a8b8-31b234c47687\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") "
Jul 07 16:52:05.885135 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885013    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-envoy\") pod \"e78440aa-b338-4321-a8b8-31b234c47687\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") "
Jul 07 16:52:05.885135 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885076    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e78440aa-b338-4321-a8b8-31b234c47687-istio-podinfo\") pod \"e78440aa-b338-4321-a8b8-31b234c47687\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") "
Jul 07 16:52:05.885135 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885107    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-socket\") pod \"e78440aa-b338-4321-a8b8-31b234c47687\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") "
Jul 07 16:52:05.885357 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885151    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-credential-socket\") pod \"e78440aa-b338-4321-a8b8-31b234c47687\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") "
Jul 07 16:52:05.885357 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885188    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-data\") pod \"e78440aa-b338-4321-a8b8-31b234c47687\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") "
Jul 07 16:52:05.885357 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885170    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e78440aa-b338-4321-a8b8-31b234c47687" (UID: "e78440aa-b338-4321-a8b8-31b234c47687"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:05.885357 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885218    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-istio-token\") pod \"e78440aa-b338-4321-a8b8-31b234c47687\" (UID: \"e78440aa-b338-4321-a8b8-31b234c47687\") "
Jul 07 16:52:05.885357 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885321    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e78440aa-b338-4321-a8b8-31b234c47687-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e78440aa-b338-4321-a8b8-31b234c47687" (UID: "e78440aa-b338-4321-a8b8-31b234c47687"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:52:05.885615 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885417    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e78440aa-b338-4321-a8b8-31b234c47687" (UID: "e78440aa-b338-4321-a8b8-31b234c47687"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:05.885615 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885599    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:05.885722 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885625    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:05.885722 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.885641    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e78440aa-b338-4321-a8b8-31b234c47687-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:05.886340 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.886211    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-data" (OuterVolumeSpecName: "istio-data") pod "e78440aa-b338-4321-a8b8-31b234c47687" (UID: "e78440aa-b338-4321-a8b8-31b234c47687"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:05.886340 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.886312    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e78440aa-b338-4321-a8b8-31b234c47687" (UID: "e78440aa-b338-4321-a8b8-31b234c47687"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:05.887503 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.887478    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-kube-api-access-cv2xk" (OuterVolumeSpecName: "kube-api-access-cv2xk") pod "e78440aa-b338-4321-a8b8-31b234c47687" (UID: "e78440aa-b338-4321-a8b8-31b234c47687"). InnerVolumeSpecName "kube-api-access-cv2xk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:05.887503 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.887480    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e78440aa-b338-4321-a8b8-31b234c47687-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e78440aa-b338-4321-a8b8-31b234c47687" (UID: "e78440aa-b338-4321-a8b8-31b234c47687"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:52:05.887704 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.887681    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-istio-token" (OuterVolumeSpecName: "istio-token") pod "e78440aa-b338-4321-a8b8-31b234c47687" (UID: "e78440aa-b338-4321-a8b8-31b234c47687"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:05.887747 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.887713    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e78440aa-b338-4321-a8b8-31b234c47687" (UID: "e78440aa-b338-4321-a8b8-31b234c47687"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:05.986492 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.986462    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:05.986492 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.986486    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:05.986492 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.986494    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv2xk\" (UniqueName: \"kubernetes.io/projected/e78440aa-b338-4321-a8b8-31b234c47687-kube-api-access-cv2xk\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:05.986725 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.986505    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:05.986725 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.986513    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e78440aa-b338-4321-a8b8-31b234c47687-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:05.986725 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:05.986521    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e78440aa-b338-4321-a8b8-31b234c47687-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:06.564893 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.564858    2563 generic.go:356] "Generic (PLEG): container finished" podID="e78440aa-b338-4321-a8b8-31b234c47687" containerID="21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a" exitCode=0
Jul 07 16:52:06.565095 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.564907    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"
Jul 07 16:52:06.565095 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.564948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" event={"ID":"e78440aa-b338-4321-a8b8-31b234c47687","Type":"ContainerDied","Data":"21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a"}
Jul 07 16:52:06.565095 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.565010    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv" event={"ID":"e78440aa-b338-4321-a8b8-31b234c47687","Type":"ContainerDied","Data":"c712c5f6558fea4042a4171f5a18c40ad313240e9832d3ff5a8b774e9dbcd143"}
Jul 07 16:52:06.565095 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.565040    2563 scope.go:117] "RemoveContainer" containerID="21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a"
Jul 07 16:52:06.573904 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.573889    2563 scope.go:117] "RemoveContainer" containerID="9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0"
Jul 07 16:52:06.581368 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.581347    2563 scope.go:117] "RemoveContainer" containerID="21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a"
Jul 07 16:52:06.581645 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:52:06.581627    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a\": container with ID starting with 21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a not found: ID does not exist" containerID="21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a"
Jul 07 16:52:06.581695 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.581654    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a"} err="failed to get container status \"21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a\": rpc error: code = NotFound desc = could not find container \"21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a\": container with ID starting with 21c816d6f4e5591f92bbb3ac00fb5caa8274d3da50140d2944cd10409a457b5a not found: ID does not exist"
Jul 07 16:52:06.581695 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.581672    2563 scope.go:117] "RemoveContainer" containerID="9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0"
Jul 07 16:52:06.581927 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:52:06.581909    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0\": container with ID starting with 9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0 not found: ID does not exist" containerID="9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0"
Jul 07 16:52:06.581973 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.581933    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0"} err="failed to get container status \"9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0\": rpc error: code = NotFound desc = could not find container \"9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0\": container with ID starting with 9bf0f0d0dd8d87df369c97f57b9d6f73223f5d592cfcc68904cf0134d4d080c0 not found: ID does not exist"
Jul 07 16:52:06.593424 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.593404    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"]
Jul 07 16:52:06.610057 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:06.610030    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-592405-openshift-default-6ddbbc7c6c-9gjfv"]
Jul 07 16:52:07.386051 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:07.386017    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e78440aa-b338-4321-a8b8-31b234c47687" path="/var/lib/kubelet/pods/e78440aa-b338-4321-a8b8-31b234c47687/volumes"
Jul 07 16:52:08.571454 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:08.571417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:08.716614 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:08.716579    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:08.860048 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:08.860018    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"]
Jul 07 16:52:08.860288 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:08.860265    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy" containerID="cri-o://4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859" gracePeriod=30
Jul 07 16:52:08.926139 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:08.926114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:09.037489 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.037460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:09.152345 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.152258    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:09.506724 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.506647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:09.849613 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.849539    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"]
Jul 07 16:52:09.849992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.849824    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b49f8034-e909-451a-a632-e794772bbd6e" containerName="main"
Jul 07 16:52:09.849992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.849856    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b49f8034-e909-451a-a632-e794772bbd6e" containerName="main"
Jul 07 16:52:09.849992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.849872    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy"
Jul 07 16:52:09.849992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.849878    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy"
Jul 07 16:52:09.849992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.849887    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy"
Jul 07 16:52:09.849992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.849892    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy"
Jul 07 16:52:09.849992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.849953    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy"
Jul 07 16:52:09.849992 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.849963    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b49f8034-e909-451a-a632-e794772bbd6e" containerName="main"
Jul 07 16:52:09.854322 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.854304    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:09.857824 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.857804    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-6a9526-openshift-default-dockercfg-x5tfv\""
Jul 07 16:52:09.885568 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.885543    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"]
Jul 07 16:52:09.916410 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.916371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-socket\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:09.916537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.916460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-podinfo\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:09.916537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.916501    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-token\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:09.916633 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.916550    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istiod-ca-cert\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:09.916633 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.916573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-certs\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:09.916633 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.916597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-data\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:09.916633 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.916621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-credential-socket\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:09.916769 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.916695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-envoy\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:09.916769 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.916745    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjn57\" (UniqueName: \"kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-kube-api-access-cjn57\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:09.919439 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:09.919417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:10.017272 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017229    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-socket\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.017471 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017283    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-podinfo\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.017471 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017460    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-token\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.017601 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istiod-ca-cert\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.017601 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017530    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-certs\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.017601 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017571    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-data\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.017751 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017677    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-socket\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.017814 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-credential-socket\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.017814 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017798    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-envoy\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.017957 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjn57\" (UniqueName: \"kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-kube-api-access-cjn57\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.017957 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017875    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-data\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.018057 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.017957    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-certs\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.018147 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.018124    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-credential-socket\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.018462 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.018433    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istiod-ca-cert\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.019932 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.019912    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-podinfo\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.020063 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.019938    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-envoy\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.026126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.026104    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-token\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.026385 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.026358    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjn57\" (UniqueName: \"kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-kube-api-access-cjn57\") pod \"e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") " pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.131578 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.131553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:10.163610 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.163585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:10.324566 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.324534    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"]
Jul 07 16:52:10.327948 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:52:10.327916    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod175f9ba4_7ab4_409c_9fcf_fffafb636be9.slice/crio-9c6ea9c734be1de15aa703291747e6edf8b84b638eabc830df0dcd69b08d0c18 WatchSource:0}: Error finding container 9c6ea9c734be1de15aa703291747e6edf8b84b638eabc830df0dcd69b08d0c18: Status 404 returned error can't find the container with id 9c6ea9c734be1de15aa703291747e6edf8b84b638eabc830df0dcd69b08d0c18
Jul 07 16:52:10.330128 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.330093    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:10.330212 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.330178    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:10.330251 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.330216    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:10.584952 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.584863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" event={"ID":"175f9ba4-7ab4-409c-9fcf-fffafb636be9","Type":"ContainerStarted","Data":"377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212"}
Jul 07 16:52:10.584952 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.584936    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" event={"ID":"175f9ba4-7ab4-409c-9fcf-fffafb636be9","Type":"ContainerStarted","Data":"9c6ea9c734be1de15aa703291747e6edf8b84b638eabc830df0dcd69b08d0c18"}
Jul 07 16:52:10.617482 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:10.617434    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" podStartSLOduration=1.61741837 podStartE2EDuration="1.61741837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:52:10.617255435 +0000 UTC m=+2023.971540683" watchObservedRunningTime="2026-07-07 16:52:10.61741837 +0000 UTC m=+2023.971703618"
Jul 07 16:52:11.164291 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:11.164253    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:11.169133 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:11.169110    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:11.589764 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:11.589683    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:11.590775 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:11.590759    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:12.647209 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:12.647176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:12.787109 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:12.787082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:12.953532 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:12.953454    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:13.626299 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:13.626265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:13.754963 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:13.754931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:14.103467 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.103444    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:52:14.157654 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.157583    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-envoy\") pod \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") "
Jul 07 16:52:14.157654 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.157618    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-credential-socket\") pod \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") "
Jul 07 16:52:14.157654 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.157650    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istiod-ca-cert\") pod \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") "
Jul 07 16:52:14.157891 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.157703    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-podinfo\") pod \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") "
Jul 07 16:52:14.157891 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.157728    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-certs\") pod \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") "
Jul 07 16:52:14.157891 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.157754    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-socket\") pod \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") "
Jul 07 16:52:14.157891 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.157798    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-token\") pod \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") "
Jul 07 16:52:14.157891 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.157824    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mjkd\" (UniqueName: \"kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-kube-api-access-9mjkd\") pod \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") "
Jul 07 16:52:14.158142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.157895    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-data\") pod \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\" (UID: \"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4\") "
Jul 07 16:52:14.158142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.157929    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" (UID: "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:14.158142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.158005    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" (UID: "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:14.158142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.158106    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" (UID: "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:14.158142 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.158118    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" (UID: "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:52:14.158377 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.158227    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:14.158377 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.158250    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:14.158377 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.158264    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:14.158377 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.158279    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:14.158854 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.158808    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-data" (OuterVolumeSpecName: "istio-data") pod "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" (UID: "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:14.159811 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.159788    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" (UID: "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:14.159985 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.159966    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-token" (OuterVolumeSpecName: "istio-token") pod "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" (UID: "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:14.160129 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.160110    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" (UID: "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:52:14.160196 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.160111    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-kube-api-access-9mjkd" (OuterVolumeSpecName: "kube-api-access-9mjkd") pod "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" (UID: "f00e0ef2-2aa3-4185-819e-d8d90b5dbea4"). InnerVolumeSpecName "kube-api-access-9mjkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:14.258792 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.258766    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:14.258792 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.258789    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mjkd\" (UniqueName: \"kubernetes.io/projected/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-kube-api-access-9mjkd\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:14.258988 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.258800    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:14.258988 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.258809    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:14.258988 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.258816    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:14.603072 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.602977    2563 generic.go:356] "Generic (PLEG): container finished" podID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerID="4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859" exitCode=0
Jul 07 16:52:14.603072 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.603030    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"
Jul 07 16:52:14.603072 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.603062    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" event={"ID":"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4","Type":"ContainerDied","Data":"4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859"}
Jul 07 16:52:14.603351 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.603110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m" event={"ID":"f00e0ef2-2aa3-4185-819e-d8d90b5dbea4","Type":"ContainerDied","Data":"bc349eda57290b84d2980074b5cc5128c4ed72c51952a0d4a19739b99b2f463d"}
Jul 07 16:52:14.603351 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.603131    2563 scope.go:117] "RemoveContainer" containerID="4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859"
Jul 07 16:52:14.611777 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.611759    2563 scope.go:117] "RemoveContainer" containerID="6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38"
Jul 07 16:52:14.619256 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.619237    2563 scope.go:117] "RemoveContainer" containerID="4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859"
Jul 07 16:52:14.619490 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:52:14.619471    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859\": container with ID starting with 4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859 not found: ID does not exist" containerID="4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859"
Jul 07 16:52:14.619543 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.619497    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859"} err="failed to get container status \"4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859\": rpc error: code = NotFound desc = could not find container \"4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859\": container with ID starting with 4f76cd61c704fd928746ea23b746e564451f117fc4a415ae62fe89ad39cbd859 not found: ID does not exist"
Jul 07 16:52:14.619543 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.619516    2563 scope.go:117] "RemoveContainer" containerID="6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38"
Jul 07 16:52:14.619760 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:52:14.619743    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38\": container with ID starting with 6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38 not found: ID does not exist" containerID="6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38"
Jul 07 16:52:14.619859 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.619766    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38"} err="failed to get container status \"6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38\": rpc error: code = NotFound desc = could not find container \"6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38\": container with ID starting with 6d6f831c7d27a60295597bceaa50445852e28ce3c9089529e5814e4a6eb2cf38 not found: ID does not exist"
Jul 07 16:52:14.630555 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.630532    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"]
Jul 07 16:52:14.640237 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:14.640216    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-cfae17-openshift-default-6bdd7fcd49-5lm8m"]
Jul 07 16:52:15.386617 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:15.386575    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" path="/var/lib/kubelet/pods/f00e0ef2-2aa3-4185-819e-d8d90b5dbea4/volumes"
Jul 07 16:52:16.958694 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:16.958665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:17.094953 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:17.094925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:17.234674 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:17.234589    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:17.744080 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:17.744050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:18.019820 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.019740    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"]
Jul 07 16:52:18.020175 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.020063    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy"
Jul 07 16:52:18.020175 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.020075    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy"
Jul 07 16:52:18.020175 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.020084    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy"
Jul 07 16:52:18.020175 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.020091    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy"
Jul 07 16:52:18.020175 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.020138    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e78440aa-b338-4321-a8b8-31b234c47687" containerName="istio-proxy"
Jul 07 16:52:18.020175 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.020149    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy"
Jul 07 16:52:18.020175 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.020155    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f00e0ef2-2aa3-4185-819e-d8d90b5dbea4" containerName="istio-proxy"
Jul 07 16:52:18.024586 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.024566    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.031218 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.031085    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-d0ba35-openshift-default-dockercfg-rw65b\""
Jul 07 16:52:18.055645 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.055621    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"]
Jul 07 16:52:18.076500 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.076478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:18.088434 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.088409    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-envoy\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.088527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.088448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-credential-socket\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.088527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.088487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istiod-ca-cert\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.088527 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.088518    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-token\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.088645 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.088555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-certs\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.088645 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.088578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-data\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.088645 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.088600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-podinfo\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.088791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.088698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jskrp\" (UniqueName: \"kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-kube-api-access-jskrp\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.088791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.088753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-socket\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.189389 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.189357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jskrp\" (UniqueName: \"kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-kube-api-access-jskrp\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.189550 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.189402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-socket\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.189550 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.189448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-envoy\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.189550 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.189476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-credential-socket\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.189550 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.189506    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istiod-ca-cert\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.189790 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.189534    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-token\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.189790 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.189613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-certs\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.189790 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.189652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-data\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.189790 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.189674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-podinfo\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.190039 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.189926    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-socket\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.190113 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.190090    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-certs\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.190178 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.190112    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-data\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.190178 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.190139    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-credential-socket\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.190543 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.190522    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istiod-ca-cert\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.191926 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.191910    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-envoy\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.192342 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.192323    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-podinfo\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.201704 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.201673    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-token\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.202683 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.202658    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jskrp\" (UniqueName: \"kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-kube-api-access-jskrp\") pod \"e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") " pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.336114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.335961    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:18.477575 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.477545    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"]
Jul 07 16:52:18.478197 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:52:18.478174    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32c38cff_8107_4caf_92ad_e16d6d3c9ae2.slice/crio-61b96f6326a622b2662ea00d611c78498f91e42b93ab8bc39dc4f2619a6b6bbc WatchSource:0}: Error finding container 61b96f6326a622b2662ea00d611c78498f91e42b93ab8bc39dc4f2619a6b6bbc: Status 404 returned error can't find the container with id 61b96f6326a622b2662ea00d611c78498f91e42b93ab8bc39dc4f2619a6b6bbc
Jul 07 16:52:18.480643 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.480617    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:18.480697 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.480675    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:18.480732 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.480702    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:18.624030 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.624000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" event={"ID":"32c38cff-8107-4caf-92ad-e16d6d3c9ae2","Type":"ContainerStarted","Data":"c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2"}
Jul 07 16:52:18.624186 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.624049    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" event={"ID":"32c38cff-8107-4caf-92ad-e16d6d3c9ae2","Type":"ContainerStarted","Data":"61b96f6326a622b2662ea00d611c78498f91e42b93ab8bc39dc4f2619a6b6bbc"}
Jul 07 16:52:18.649528 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.649475    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" podStartSLOduration=1.649455105 podStartE2EDuration="1.649455105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:52:18.648121966 +0000 UTC m=+2032.002407226" watchObservedRunningTime="2026-07-07 16:52:18.649455105 +0000 UTC m=+2032.003740356"
Jul 07 16:52:18.676047 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:18.676017    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:19.338577 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:19.338530    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:19.347460 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:19.347430    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:19.629380 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:19.629351    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:19.634322 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:19.634290    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:20.739986 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:20.739952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:20.845637 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:20.845596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:20.942369 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:20.942335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:21.041791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:21.041670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:21.452511 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:21.452474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:21.553379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:21.553347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:25.218870 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:25.218819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:26.591972 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:26.591859    2563 patch_prober.go:28] interesting pod/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 07 16:52:26.591972 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:26.591937    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 07 16:52:26.667979 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:26.667948    2563 generic.go:356] "Generic (PLEG): container finished" podID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerID="377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212" exitCode=0
Jul 07 16:52:26.668122 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:26.668015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" event={"ID":"175f9ba4-7ab4-409c-9fcf-fffafb636be9","Type":"ContainerDied","Data":"377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212"}
Jul 07 16:52:26.668434 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:26.668417    2563 scope.go:117] "RemoveContainer" containerID="377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212"
Jul 07 16:52:26.669400 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:26.669375    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:26.669458 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:26.669442    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:26.669493 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:26.669484    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:27.677156 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:27.677109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" event={"ID":"175f9ba4-7ab4-409c-9fcf-fffafb636be9","Type":"ContainerStarted","Data":"f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474"}
Jul 07 16:52:28.164428 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:28.164391    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:28.164916 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:28.164885    2563 patch_prober.go:28] interesting pod/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 07 16:52:28.165203 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:28.165173    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 07 16:52:29.164233 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:29.164195    2563 patch_prober.go:28] interesting pod/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 07 16:52:29.164599 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:29.164262    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 07 16:52:30.164019 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:30.163977    2563 patch_prober.go:28] interesting pod/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 07 16:52:30.164223 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:30.164043    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 07 16:52:31.164667 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:31.164633    2563 patch_prober.go:28] interesting pod/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Jul 07 16:52:31.165072 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:31.164688    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Jul 07 16:52:32.168025 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:32.167997    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:32.168412 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:32.168389    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:32.168973 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:32.168955    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:32.704297 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:32.704262    2563 generic.go:356] "Generic (PLEG): container finished" podID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerID="c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2" exitCode=0
Jul 07 16:52:32.704467 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:32.704333    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" event={"ID":"32c38cff-8107-4caf-92ad-e16d6d3c9ae2","Type":"ContainerDied","Data":"c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2"}
Jul 07 16:52:32.704820 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:32.704805    2563 scope.go:117] "RemoveContainer" containerID="c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2"
Jul 07 16:52:32.705862 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:32.705825    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:32.705924 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:32.705901    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:32.705962 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:32.705934    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:33.421487 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:33.421394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:33.710046 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:33.709957    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" event={"ID":"32c38cff-8107-4caf-92ad-e16d6d3c9ae2","Type":"ContainerStarted","Data":"b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b"}
Jul 07 16:52:33.815018 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:33.814981    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:33.916009 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:33.915977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:34.020145 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:34.020054    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:34.175063 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:34.175033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:34.336186 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:34.336090    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:34.337932 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:34.337891    2563 patch_prober.go:28] interesting pod/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 07 16:52:34.338167 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:34.338124    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 07 16:52:34.630246 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:34.630208    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:35.336952 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:35.336918    2563 patch_prober.go:28] interesting pod/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 07 16:52:35.337236 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:35.337206    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 07 16:52:36.336904 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:36.336858    2563 patch_prober.go:28] interesting pod/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 07 16:52:36.337438 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:36.336941    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 07 16:52:37.336946 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:37.336901    2563 patch_prober.go:28] interesting pod/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jul 07 16:52:37.337562 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:37.336968    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jul 07 16:52:38.341049 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:38.341015    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:38.342173 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:38.342150    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:39.964489 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:39.964455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:40.062252 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:40.062220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:40.194005 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:40.193976    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"]
Jul 07 16:52:40.194193 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:40.194172    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy" containerID="cri-o://f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474" gracePeriod=30
Jul 07 16:52:40.221580 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:40.221503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:40.480459 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:40.480374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:40.638436 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:40.638405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:41.037334 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:41.037301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:41.145323 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:41.145291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:41.237926 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:41.237881    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:41.378282 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:41.378254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:45.436491 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.436467    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:45.542667 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.542591    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-certs\") pod \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") "
Jul 07 16:52:45.542667 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.542640    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-socket\") pod \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") "
Jul 07 16:52:45.542876 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.542684    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjn57\" (UniqueName: \"kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-kube-api-access-cjn57\") pod \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") "
Jul 07 16:52:45.542876 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.542748    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istiod-ca-cert\") pod \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") "
Jul 07 16:52:45.542876 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.542778    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-credential-socket\") pod \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") "
Jul 07 16:52:45.542876 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.542816    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-token\") pod \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") "
Jul 07 16:52:45.543091 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.542895    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-data\") pod \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") "
Jul 07 16:52:45.543091 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.542925    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "175f9ba4-7ab4-409c-9fcf-fffafb636be9" (UID: "175f9ba4-7ab4-409c-9fcf-fffafb636be9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:45.543091 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.542928    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-podinfo\") pod \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") "
Jul 07 16:52:45.543091 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.543003    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-envoy\") pod \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\" (UID: \"175f9ba4-7ab4-409c-9fcf-fffafb636be9\") "
Jul 07 16:52:45.543091 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.543015    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "175f9ba4-7ab4-409c-9fcf-fffafb636be9" (UID: "175f9ba4-7ab4-409c-9fcf-fffafb636be9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:45.543335 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.543124    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "175f9ba4-7ab4-409c-9fcf-fffafb636be9" (UID: "175f9ba4-7ab4-409c-9fcf-fffafb636be9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:45.543335 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.543246    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "175f9ba4-7ab4-409c-9fcf-fffafb636be9" (UID: "175f9ba4-7ab4-409c-9fcf-fffafb636be9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:52:45.543435 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.543333    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:45.543435 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.543353    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:45.543435 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.543368    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:45.543435 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.543382    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:45.543711 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.543691    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-data" (OuterVolumeSpecName: "istio-data") pod "175f9ba4-7ab4-409c-9fcf-fffafb636be9" (UID: "175f9ba4-7ab4-409c-9fcf-fffafb636be9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:45.545519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.545489    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-token" (OuterVolumeSpecName: "istio-token") pod "175f9ba4-7ab4-409c-9fcf-fffafb636be9" (UID: "175f9ba4-7ab4-409c-9fcf-fffafb636be9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:45.545519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.545507    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-kube-api-access-cjn57" (OuterVolumeSpecName: "kube-api-access-cjn57") pod "175f9ba4-7ab4-409c-9fcf-fffafb636be9" (UID: "175f9ba4-7ab4-409c-9fcf-fffafb636be9"). InnerVolumeSpecName "kube-api-access-cjn57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:45.545519 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.545516    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "175f9ba4-7ab4-409c-9fcf-fffafb636be9" (UID: "175f9ba4-7ab4-409c-9fcf-fffafb636be9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:45.545688 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.545528    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "175f9ba4-7ab4-409c-9fcf-fffafb636be9" (UID: "175f9ba4-7ab4-409c-9fcf-fffafb636be9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:52:45.644116 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.644088    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjn57\" (UniqueName: \"kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-kube-api-access-cjn57\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:45.644116 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.644114    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:45.644116 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.644123    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:45.644313 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.644131    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:45.644313 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.644139    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/175f9ba4-7ab4-409c-9fcf-fffafb636be9-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:45.758864 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.758815    2563 generic.go:356] "Generic (PLEG): container finished" podID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerID="f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474" exitCode=0
Jul 07 16:52:45.759026 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.758864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" event={"ID":"175f9ba4-7ab4-409c-9fcf-fffafb636be9","Type":"ContainerDied","Data":"f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474"}
Jul 07 16:52:45.759026 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.758884    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"
Jul 07 16:52:45.759026 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.758921    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql" event={"ID":"175f9ba4-7ab4-409c-9fcf-fffafb636be9","Type":"ContainerDied","Data":"9c6ea9c734be1de15aa703291747e6edf8b84b638eabc830df0dcd69b08d0c18"}
Jul 07 16:52:45.759026 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.758944    2563 scope.go:117] "RemoveContainer" containerID="f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474"
Jul 07 16:52:45.767888 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.767872    2563 scope.go:117] "RemoveContainer" containerID="377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212"
Jul 07 16:52:45.775248 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.775230    2563 scope.go:117] "RemoveContainer" containerID="f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474"
Jul 07 16:52:45.775502 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:52:45.775481    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474\": container with ID starting with f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474 not found: ID does not exist" containerID="f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474"
Jul 07 16:52:45.775547 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.775510    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474"} err="failed to get container status \"f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474\": rpc error: code = NotFound desc = could not find container \"f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474\": container with ID starting with f1800d520d6e72077d1c3d42f6a983f9014938cf57f011db4961d41b27af1474 not found: ID does not exist"
Jul 07 16:52:45.775547 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.775527    2563 scope.go:117] "RemoveContainer" containerID="377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212"
Jul 07 16:52:45.775742 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:52:45.775725    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212\": container with ID starting with 377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212 not found: ID does not exist" containerID="377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212"
Jul 07 16:52:45.775795 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.775751    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212"} err="failed to get container status \"377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212\": rpc error: code = NotFound desc = could not find container \"377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212\": container with ID starting with 377dcbf099e12a511b3facaf3a167fa99fc468374bcf2a37eb5936c8a778b212 not found: ID does not exist"
Jul 07 16:52:45.783631 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.783611    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"]
Jul 07 16:52:45.788567 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:45.788547    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-6a9526-openshift-default-c7d79f4d9-6hcql"]
Jul 07 16:52:46.923675 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:46.923642    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:47.009661 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:47.009629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:47.221679 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:47.221593    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"]
Jul 07 16:52:47.221821 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:47.221797    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy" containerID="cri-o://b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b" gracePeriod=30
Jul 07 16:52:47.254419 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:47.254382    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:47.386400 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:47.386368    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" path="/var/lib/kubelet/pods/175f9ba4-7ab4-409c-9fcf-fffafb636be9/volumes"
Jul 07 16:52:47.521999 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:47.521923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:47.852731 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:47.852656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:48.176855 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.176813    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"]
Jul 07 16:52:48.177306 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.177288    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy"
Jul 07 16:52:48.177352 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.177311    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy"
Jul 07 16:52:48.177352 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.177336    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy"
Jul 07 16:52:48.177352 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.177344    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy"
Jul 07 16:52:48.177464 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.177448    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy"
Jul 07 16:52:48.177464 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.177460    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="175f9ba4-7ab4-409c-9fcf-fffafb636be9" containerName="istio-proxy"
Jul 07 16:52:48.182248 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.182229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.185497 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.185476    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9926c0-openshift-default-dockercfg-wq88g\""
Jul 07 16:52:48.195743 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.195717    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"]
Jul 07 16:52:48.205075 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.205048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:48.365587 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.365555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-credential-socket\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.365587 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.365591    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd576be5-9833-4f23-be26-cf06e9d51275-istio-podinfo\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.365807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.365614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-istio-token\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.365807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.365703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8snnw\" (UniqueName: \"kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-kube-api-access-8snnw\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.365807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.365738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-data\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.365807 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.365772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-socket\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.365970 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.365816    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-certs\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.365970 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.365861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd576be5-9833-4f23-be26-cf06e9d51275-istiod-ca-cert\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.365970 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.365887    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-envoy\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.392335 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.392306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:48.467241 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-envoy\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.467241 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-credential-socket\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.467241 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467221    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd576be5-9833-4f23-be26-cf06e9d51275-istio-podinfo\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.467493 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-istio-token\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.467493 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8snnw\" (UniqueName: \"kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-kube-api-access-8snnw\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.467493 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-data\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.467493 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467397    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-socket\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.467493 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-certs\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.467493 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd576be5-9833-4f23-be26-cf06e9d51275-istiod-ca-cert\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.467817 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467611    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-credential-socket\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.467938 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467911    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-data\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.468084 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.467965    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-certs\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.468084 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.468058    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-socket\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.468196 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.468170    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd576be5-9833-4f23-be26-cf06e9d51275-istiod-ca-cert\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.469695 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.469673    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-envoy\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.470039 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.470015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd576be5-9833-4f23-be26-cf06e9d51275-istio-podinfo\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.476193 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.476158    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-istio-token\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.476316 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.476293    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8snnw\" (UniqueName: \"kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-kube-api-access-8snnw\") pod \"e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") " pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.492624 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.492605    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:48.493480 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.493448    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:48.624068 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.624029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:48.638491 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.638470    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"]
Jul 07 16:52:48.640364 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:52:48.640337    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd576be5_9833_4f23_be26_cf06e9d51275.slice/crio-a06458eaee377dc3072e4210b6f45eba67981a34924ac97c1a2961fa61a2edb7 WatchSource:0}: Error finding container a06458eaee377dc3072e4210b6f45eba67981a34924ac97c1a2961fa61a2edb7: Status 404 returned error can't find the container with id a06458eaee377dc3072e4210b6f45eba67981a34924ac97c1a2961fa61a2edb7
Jul 07 16:52:48.642322 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.642294    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:48.642392 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.642355    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:48.642392 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.642381    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:48.774968 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.774879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" event={"ID":"cd576be5-9833-4f23-be26-cf06e9d51275","Type":"ContainerStarted","Data":"e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2"}
Jul 07 16:52:48.774968 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.774942    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" event={"ID":"cd576be5-9833-4f23-be26-cf06e9d51275","Type":"ContainerStarted","Data":"a06458eaee377dc3072e4210b6f45eba67981a34924ac97c1a2961fa61a2edb7"}
Jul 07 16:52:48.799680 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:48.799628    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" podStartSLOduration=0.799611922 podStartE2EDuration="799.611922ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:52:48.796547649 +0000 UTC m=+2062.150832898" watchObservedRunningTime="2026-07-07 16:52:48.799611922 +0000 UTC m=+2062.153897170"
Jul 07 16:52:49.493132 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:49.493052    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:49.497823 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:49.497798    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:49.779246 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:49.779166    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:49.780264 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:49.780244    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:52:50.749259 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:50.749200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:50.862626 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:50.862593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:50.986761 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:50.986728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:51.156607 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:51.156574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:51.576356 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:51.576275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:51.668247 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:51.668215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:52.471570 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.471548    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:52.503361 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503294    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-credential-socket\") pod \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") "
Jul 07 16:52:52.503361 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503359    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-envoy\") pod \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") "
Jul 07 16:52:52.503554 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503382    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-token\") pod \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") "
Jul 07 16:52:52.503554 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503411    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-socket\") pod \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") "
Jul 07 16:52:52.503554 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503430    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istiod-ca-cert\") pod \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") "
Jul 07 16:52:52.503554 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503455    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jskrp\" (UniqueName: \"kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-kube-api-access-jskrp\") pod \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") "
Jul 07 16:52:52.503554 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-podinfo\") pod \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") "
Jul 07 16:52:52.503554 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503527    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-data\") pod \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") "
Jul 07 16:52:52.503907 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503564    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-certs\") pod \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\" (UID: \"32c38cff-8107-4caf-92ad-e16d6d3c9ae2\") "
Jul 07 16:52:52.503907 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503568    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "32c38cff-8107-4caf-92ad-e16d6d3c9ae2" (UID: "32c38cff-8107-4caf-92ad-e16d6d3c9ae2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:52.503907 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503660    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "32c38cff-8107-4caf-92ad-e16d6d3c9ae2" (UID: "32c38cff-8107-4caf-92ad-e16d6d3c9ae2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:52.503907 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503779    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "32c38cff-8107-4caf-92ad-e16d6d3c9ae2" (UID: "32c38cff-8107-4caf-92ad-e16d6d3c9ae2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:52:52.504126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.503903    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "32c38cff-8107-4caf-92ad-e16d6d3c9ae2" (UID: "32c38cff-8107-4caf-92ad-e16d6d3c9ae2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:52.504126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.504032    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:52.504126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.504054    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:52.504126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.504069    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:52.504126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.504081    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:52.504658 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.504630    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-data" (OuterVolumeSpecName: "istio-data") pod "32c38cff-8107-4caf-92ad-e16d6d3c9ae2" (UID: "32c38cff-8107-4caf-92ad-e16d6d3c9ae2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:52.505730 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.505695    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "32c38cff-8107-4caf-92ad-e16d6d3c9ae2" (UID: "32c38cff-8107-4caf-92ad-e16d6d3c9ae2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:52:52.505813 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.505771    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-kube-api-access-jskrp" (OuterVolumeSpecName: "kube-api-access-jskrp") pod "32c38cff-8107-4caf-92ad-e16d6d3c9ae2" (UID: "32c38cff-8107-4caf-92ad-e16d6d3c9ae2"). InnerVolumeSpecName "kube-api-access-jskrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:52.506039 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.506007    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-token" (OuterVolumeSpecName: "istio-token") pod "32c38cff-8107-4caf-92ad-e16d6d3c9ae2" (UID: "32c38cff-8107-4caf-92ad-e16d6d3c9ae2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:52:52.506137 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.506082    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "32c38cff-8107-4caf-92ad-e16d6d3c9ae2" (UID: "32c38cff-8107-4caf-92ad-e16d6d3c9ae2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:52:52.604847 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.604804    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jskrp\" (UniqueName: \"kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-kube-api-access-jskrp\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:52.604847 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.604862    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:52.605042 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.604871    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:52.605042 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.604879    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:52.605042 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.604886    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32c38cff-8107-4caf-92ad-e16d6d3c9ae2-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:52:52.793625 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.793539    2563 generic.go:356] "Generic (PLEG): container finished" podID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerID="b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b" exitCode=0
Jul 07 16:52:52.793625 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.793593    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"
Jul 07 16:52:52.793806 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.793629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" event={"ID":"32c38cff-8107-4caf-92ad-e16d6d3c9ae2","Type":"ContainerDied","Data":"b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b"}
Jul 07 16:52:52.793806 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.793687    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6" event={"ID":"32c38cff-8107-4caf-92ad-e16d6d3c9ae2","Type":"ContainerDied","Data":"61b96f6326a622b2662ea00d611c78498f91e42b93ab8bc39dc4f2619a6b6bbc"}
Jul 07 16:52:52.793806 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.793718    2563 scope.go:117] "RemoveContainer" containerID="b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b"
Jul 07 16:52:52.802719 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.802703    2563 scope.go:117] "RemoveContainer" containerID="c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2"
Jul 07 16:52:52.810267 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.810239    2563 scope.go:117] "RemoveContainer" containerID="b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b"
Jul 07 16:52:52.810506 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:52:52.810488    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b\": container with ID starting with b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b not found: ID does not exist" containerID="b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b"
Jul 07 16:52:52.810557 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.810516    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b"} err="failed to get container status \"b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b\": rpc error: code = NotFound desc = could not find container \"b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b\": container with ID starting with b9f318563ba0deed51fb183bcc15dfd3e09ef97df122108699edeefa8c39773b not found: ID does not exist"
Jul 07 16:52:52.810557 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.810533    2563 scope.go:117] "RemoveContainer" containerID="c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2"
Jul 07 16:52:52.810752 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:52:52.810733    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2\": container with ID starting with c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2 not found: ID does not exist" containerID="c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2"
Jul 07 16:52:52.810789 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.810759    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2"} err="failed to get container status \"c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2\": rpc error: code = NotFound desc = could not find container \"c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2\": container with ID starting with c4e592a76781ab78c85a0c03212969124ed20fa5bdb7fd712cbfb2acbe29f3e2 not found: ID does not exist"
Jul 07 16:52:52.816663 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.816644    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"]
Jul 07 16:52:52.821909 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:52.821891    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-d0ba35-openshift-default-556c55db67-rqgt6"]
Jul 07 16:52:53.387160 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:53.387132    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" path="/var/lib/kubelet/pods/32c38cff-8107-4caf-92ad-e16d6d3c9ae2/volumes"
Jul 07 16:52:55.246315 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.246282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:55.599942 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.599860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:55.871587 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.871557    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"]
Jul 07 16:52:55.871900 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.871886    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy"
Jul 07 16:52:55.871975 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.871901    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy"
Jul 07 16:52:55.871975 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.871957    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy"
Jul 07 16:52:55.871975 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.871965    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy"
Jul 07 16:52:55.876424 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.876403    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:55.879900 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.879870    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-3c33bd-openshift-default-dockercfg-m65lt\""
Jul 07 16:52:55.893012 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.892985    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"]
Jul 07 16:52:55.918331 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.918305    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:55.933509 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.933485    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-envoy\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:55.933595 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.933512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d396a85e-b961-443a-b3b7-94aeef57831b-istio-podinfo\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:55.933595 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.933534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-socket\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:55.933671 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.933610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d396a85e-b961-443a-b3b7-94aeef57831b-istiod-ca-cert\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:55.933671 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.933639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-certs\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:55.933671 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.933654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-data\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:55.933762 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.933670    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-istio-token\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:55.933762 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.933690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rxqz\" (UniqueName: \"kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-kube-api-access-4rxqz\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:55.933762 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:55.933738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-credential-socket\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.007654 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.007622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:56.034881 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.034833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d396a85e-b961-443a-b3b7-94aeef57831b-istiod-ca-cert\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035038 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.034894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-certs\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035038 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.034914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-data\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035038 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.034930    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-istio-token\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035038 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.034953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxqz\" (UniqueName: \"kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-kube-api-access-4rxqz\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035268 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.035119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-credential-socket\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035268 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.035202    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-envoy\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035268 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.035232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d396a85e-b961-443a-b3b7-94aeef57831b-istio-podinfo\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035268 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.035266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-socket\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035483 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.035282    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-data\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035483 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.035380    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-certs\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035483 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.035428    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-credential-socket\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035598 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.035576    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d396a85e-b961-443a-b3b7-94aeef57831b-istiod-ca-cert\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.035631 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.035583    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-socket\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.037322 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.037304    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-envoy\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.037605 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.037590    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d396a85e-b961-443a-b3b7-94aeef57831b-istio-podinfo\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.045583 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.045560    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-istio-token\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.045988 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.045967    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rxqz\" (UniqueName: \"kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-kube-api-access-4rxqz\") pod \"e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") " pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.186713 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.186636    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:56.317925 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.317896    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"]
Jul 07 16:52:56.319434 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:52:56.319409    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd396a85e_b961_443a_b3b7_94aeef57831b.slice/crio-cab51d8cad3a7d67cedc4b7128794bd11f669de46a4953aa251e1b9e63202bb7 WatchSource:0}: Error finding container cab51d8cad3a7d67cedc4b7128794bd11f669de46a4953aa251e1b9e63202bb7: Status 404 returned error can't find the container with id cab51d8cad3a7d67cedc4b7128794bd11f669de46a4953aa251e1b9e63202bb7
Jul 07 16:52:56.321573 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.321542    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:56.321653 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.321607    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:56.321690 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.321650    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:52:56.815630 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.815597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" event={"ID":"d396a85e-b961-443a-b3b7-94aeef57831b","Type":"ContainerStarted","Data":"71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01"}
Jul 07 16:52:56.815813 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:56.815656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" event={"ID":"d396a85e-b961-443a-b3b7-94aeef57831b","Type":"ContainerStarted","Data":"cab51d8cad3a7d67cedc4b7128794bd11f669de46a4953aa251e1b9e63202bb7"}
Jul 07 16:52:57.187346 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:57.187306    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:57.192184 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:57.192160    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:57.216943 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:57.216894    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" podStartSLOduration=2.216880548 podStartE2EDuration="2.216880548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:52:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:52:56.84901545 +0000 UTC m=+2070.203300699" watchObservedRunningTime="2026-07-07 16:52:57.216880548 +0000 UTC m=+2070.571165797"
Jul 07 16:52:57.821146 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:57.821115    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:57.822172 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:57.822154    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:52:58.919637 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:58.919605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:59.026344 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:59.026309    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:59.135291 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:59.135241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:59.286624 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:59.286521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:59.705091 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:59.705060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:52:59.807322 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:52:59.807267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:53:03.323367 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:03.323319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:53:03.855294 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:03.855210    2563 generic.go:356] "Generic (PLEG): container finished" podID="cd576be5-9833-4f23-be26-cf06e9d51275" containerID="e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2" exitCode=0
Jul 07 16:53:03.855294 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:03.855247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" event={"ID":"cd576be5-9833-4f23-be26-cf06e9d51275","Type":"ContainerDied","Data":"e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2"}
Jul 07 16:53:03.855633 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:03.855619    2563 scope.go:117] "RemoveContainer" containerID="e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2"
Jul 07 16:53:03.856670 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:03.856642    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:53:03.856769 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:03.856719    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:53:03.856831 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:03.856767    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:53:04.779534 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:04.779492    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:53:04.862227 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:04.862188    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" event={"ID":"cd576be5-9833-4f23-be26-cf06e9d51275","Type":"ContainerStarted","Data":"732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919"}
Jul 07 16:53:05.493188 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:05.493152    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:53:05.494171 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:05.494151    2563 patch_prober.go:28] interesting pod/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 07 16:53:05.494231 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:05.494198    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 07 16:53:06.493572 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:06.493536    2563 patch_prober.go:28] interesting pod/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 07 16:53:06.494057 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:06.493604    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 07 16:53:07.494148 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:07.494106    2563 patch_prober.go:28] interesting pod/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 07 16:53:07.494583 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:07.494164    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 07 16:53:08.493829 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:08.493789    2563 patch_prober.go:28] interesting pod/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Jul 07 16:53:08.494078 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:08.494057    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Jul 07 16:53:09.496922 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:09.496883    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:53:09.497359 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:09.497144    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:53:09.497771 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:09.497756    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:53:12.822653 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:12.822579    2563 patch_prober.go:28] interesting pod/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 07 16:53:12.822653 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:12.822633    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 07 16:53:12.905775 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:12.905702    2563 generic.go:356] "Generic (PLEG): container finished" podID="d396a85e-b961-443a-b3b7-94aeef57831b" containerID="71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01" exitCode=0
Jul 07 16:53:12.905931 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:12.905771    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" event={"ID":"d396a85e-b961-443a-b3b7-94aeef57831b","Type":"ContainerDied","Data":"71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01"}
Jul 07 16:53:12.906159 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:12.906146    2563 scope.go:117] "RemoveContainer" containerID="71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01"
Jul 07 16:53:12.907169 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:12.907145    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:53:12.907240 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:12.907211    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:53:12.907285 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:12.907240    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 16:53:13.480793 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:13.480758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:53:13.580391 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:13.580362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:53:13.911488 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:13.911456    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" event={"ID":"d396a85e-b961-443a-b3b7-94aeef57831b","Type":"ContainerStarted","Data":"244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f"}
Jul 07 16:53:14.187263 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:14.187163    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:53:14.187460 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:14.187437    2563 patch_prober.go:28] interesting pod/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 07 16:53:14.187508 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:14.187488    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 07 16:53:15.187724 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.187690    2563 patch_prober.go:28] interesting pod/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 07 16:53:15.188254 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.187743    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 07 16:53:15.369430 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.369399    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"]
Jul 07 16:53:15.369745 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.369724    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy"
Jul 07 16:53:15.369745 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.369741    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="32c38cff-8107-4caf-92ad-e16d6d3c9ae2" containerName="istio-proxy"
Jul 07 16:53:15.373440 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.373421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.378161 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.378121    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"auth-test-model-9926c0-kserve-self-signed-certs\""
Jul 07 16:53:15.378407 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.378179    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"default-dockercfg-w5pzn\""
Jul 07 16:53:15.378407 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.378121    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"openshift-service-ca.crt\""
Jul 07 16:53:15.378407 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.378206    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"kube-root-ca.crt\""
Jul 07 16:53:15.387086 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.387067    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"]
Jul 07 16:53:15.405714 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.405693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-tmp-dir\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.405812 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.405721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-dshm\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.405812 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.405758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27bjx\" (UniqueName: \"kubernetes.io/projected/28729d62-fdd4-4800-9861-82d548701cd9-kube-api-access-27bjx\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.405909 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.405853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-model-cache\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.405909 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.405885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28729d62-fdd4-4800-9861-82d548701cd9-tls-certs\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.405982 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.405942    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-home\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.416257 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.416232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:53:15.506993 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.506913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-home\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.506993 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.506949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-tmp-dir\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.506993 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.506968    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-dshm\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.507261 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.507012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27bjx\" (UniqueName: \"kubernetes.io/projected/28729d62-fdd4-4800-9861-82d548701cd9-kube-api-access-27bjx\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.507261 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.507043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-model-cache\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.507261 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.507065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28729d62-fdd4-4800-9861-82d548701cd9-tls-certs\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.507428 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.507346    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-tmp-dir\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.507428 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.507402    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-home\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.507502 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.507454    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-model-cache\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.509358 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.509337    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-dshm\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.509516 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.509500    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28729d62-fdd4-4800-9861-82d548701cd9-tls-certs\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.515374 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.515353    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27bjx\" (UniqueName: \"kubernetes.io/projected/28729d62-fdd4-4800-9861-82d548701cd9-kube-api-access-27bjx\") pod \"auth-test-model-9926c0-kserve-f8b554955-vfjnf\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") " pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.683080 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.683050    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:15.853755 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.853723    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"]
Jul 07 16:53:15.856084 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:53:15.856051    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28729d62_fdd4_4800_9861_82d548701cd9.slice/crio-0f5f7ec685e553c1bd44332165b1b209d27394faab012602ad30b3d353a2c106 WatchSource:0}: Error finding container 0f5f7ec685e553c1bd44332165b1b209d27394faab012602ad30b3d353a2c106: Status 404 returned error can't find the container with id 0f5f7ec685e553c1bd44332165b1b209d27394faab012602ad30b3d353a2c106
Jul 07 16:53:15.925013 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.924986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf" event={"ID":"28729d62-fdd4-4800-9861-82d548701cd9","Type":"ContainerStarted","Data":"b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06"}
Jul 07 16:53:15.925129 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.925026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf" event={"ID":"28729d62-fdd4-4800-9861-82d548701cd9","Type":"ContainerStarted","Data":"0f5f7ec685e553c1bd44332165b1b209d27394faab012602ad30b3d353a2c106"}
Jul 07 16:53:15.957637 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:15.957580    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf" podStartSLOduration=0.957566021 podStartE2EDuration="957.566021ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:53:15.956009512 +0000 UTC m=+2089.310294760" watchObservedRunningTime="2026-07-07 16:53:15.957566021 +0000 UTC m=+2089.311851269"
Jul 07 16:53:16.187430 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:16.187396    2563 patch_prober.go:28] interesting pod/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 07 16:53:16.187604 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:16.187450    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 07 16:53:17.187060 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:17.187025    2563 patch_prober.go:28] interesting pod/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Jul 07 16:53:17.187464 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:17.187073    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Jul 07 16:53:18.191497 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:18.191467    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:53:18.191910 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:18.191734    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:53:18.192464 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:18.192442    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:53:20.477437 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:20.477406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:53:20.576262 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:20.576237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:53:25.683381 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:25.683353    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:25.683797 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:25.683411    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:25.695944 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:25.695924    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:25.978307 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:25.978224    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:53:41.606444 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:53:41.606412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:54:44.988122 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:54:44.988084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:40.869412 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:55:40.869373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:45.872276 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:55:45.872238    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"]
Jul 07 16:55:45.894044 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:55:45.894016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:47.491995 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:55:47.491961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:55:53.056357 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:55:53.056283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:56:00.712625 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:00.712565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:56:00.891741 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:00.891690    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf" podUID="28729d62-fdd4-4800-9861-82d548701cd9" containerName="main" containerID="cri-o://b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06" gracePeriod=45
Jul 07 16:56:01.149192 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.149165    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:56:01.204800 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.204769    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27bjx\" (UniqueName: \"kubernetes.io/projected/28729d62-fdd4-4800-9861-82d548701cd9-kube-api-access-27bjx\") pod \"28729d62-fdd4-4800-9861-82d548701cd9\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") "
Jul 07 16:56:01.204800 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.204807    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-model-cache\") pod \"28729d62-fdd4-4800-9861-82d548701cd9\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") "
Jul 07 16:56:01.205045 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.204825    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28729d62-fdd4-4800-9861-82d548701cd9-tls-certs\") pod \"28729d62-fdd4-4800-9861-82d548701cd9\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") "
Jul 07 16:56:01.205045 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.204982    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-tmp-dir\") pod \"28729d62-fdd4-4800-9861-82d548701cd9\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") "
Jul 07 16:56:01.205045 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.205038    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-home\") pod \"28729d62-fdd4-4800-9861-82d548701cd9\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") "
Jul 07 16:56:01.205220 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.205083    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-model-cache" (OuterVolumeSpecName: "model-cache") pod "28729d62-fdd4-4800-9861-82d548701cd9" (UID: "28729d62-fdd4-4800-9861-82d548701cd9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:56:01.205220 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.205120    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-dshm\") pod \"28729d62-fdd4-4800-9861-82d548701cd9\" (UID: \"28729d62-fdd4-4800-9861-82d548701cd9\") "
Jul 07 16:56:01.205428 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.205390    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-model-cache\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:56:01.205428 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.205388    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28729d62-fdd4-4800-9861-82d548701cd9" (UID: "28729d62-fdd4-4800-9861-82d548701cd9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:56:01.205428 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.205399    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-home" (OuterVolumeSpecName: "home") pod "28729d62-fdd4-4800-9861-82d548701cd9" (UID: "28729d62-fdd4-4800-9861-82d548701cd9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:56:01.207230 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.207203    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28729d62-fdd4-4800-9861-82d548701cd9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28729d62-fdd4-4800-9861-82d548701cd9" (UID: "28729d62-fdd4-4800-9861-82d548701cd9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:56:01.207330 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.207307    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-dshm" (OuterVolumeSpecName: "dshm") pod "28729d62-fdd4-4800-9861-82d548701cd9" (UID: "28729d62-fdd4-4800-9861-82d548701cd9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:56:01.207441 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.207420    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28729d62-fdd4-4800-9861-82d548701cd9-kube-api-access-27bjx" (OuterVolumeSpecName: "kube-api-access-27bjx") pod "28729d62-fdd4-4800-9861-82d548701cd9" (UID: "28729d62-fdd4-4800-9861-82d548701cd9"). InnerVolumeSpecName "kube-api-access-27bjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:56:01.306171 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.306061    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-dshm\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:56:01.306171 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.306105    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27bjx\" (UniqueName: \"kubernetes.io/projected/28729d62-fdd4-4800-9861-82d548701cd9-kube-api-access-27bjx\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:56:01.306171 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.306122    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28729d62-fdd4-4800-9861-82d548701cd9-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:56:01.306171 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.306135    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-tmp-dir\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:56:01.306171 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.306147    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28729d62-fdd4-4800-9861-82d548701cd9-home\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:56:01.630801 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.630766    2563 generic.go:356] "Generic (PLEG): container finished" podID="28729d62-fdd4-4800-9861-82d548701cd9" containerID="b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06" exitCode=0
Jul 07 16:56:01.631001 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.630806    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"
Jul 07 16:56:01.631001 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.630817    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf" event={"ID":"28729d62-fdd4-4800-9861-82d548701cd9","Type":"ContainerDied","Data":"b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06"}
Jul 07 16:56:01.631001 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.630869    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf" event={"ID":"28729d62-fdd4-4800-9861-82d548701cd9","Type":"ContainerDied","Data":"0f5f7ec685e553c1bd44332165b1b209d27394faab012602ad30b3d353a2c106"}
Jul 07 16:56:01.631001 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.630892    2563 scope.go:117] "RemoveContainer" containerID="b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06"
Jul 07 16:56:01.638846 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.638810    2563 scope.go:117] "RemoveContainer" containerID="b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06"
Jul 07 16:56:01.639158 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:56:01.639132    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06\": container with ID starting with b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06 not found: ID does not exist" containerID="b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06"
Jul 07 16:56:01.639260 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.639163    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06"} err="failed to get container status \"b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06\": rpc error: code = NotFound desc = could not find container \"b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06\": container with ID starting with b0617d7d60203e129a53ad7cd8e2895b80a997ddd0de5a31c48c160b7d23ce06 not found: ID does not exist"
Jul 07 16:56:01.650000 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.649978    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"]
Jul 07 16:56:01.654564 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:01.654543    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/auth-test-model-9926c0-kserve-f8b554955-vfjnf"]
Jul 07 16:56:03.386934 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:03.386901    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28729d62-fdd4-4800-9861-82d548701cd9" path="/var/lib/kubelet/pods/28729d62-fdd4-4800-9861-82d548701cd9/volumes"
Jul 07 16:56:20.980281 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:20.980251    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"]
Jul 07 16:56:20.980780 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:20.980550    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28729d62-fdd4-4800-9861-82d548701cd9" containerName="main"
Jul 07 16:56:20.980780 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:20.980561    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28729d62-fdd4-4800-9861-82d548701cd9" containerName="main"
Jul 07 16:56:20.980780 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:20.980609    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28729d62-fdd4-4800-9861-82d548701cd9" containerName="main"
Jul 07 16:56:20.983738 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:20.983722    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:20.986811 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:20.986793    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"openshift-service-ca.crt\""
Jul 07 16:56:20.986811 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:20.986801    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"default-dockercfg-v8b56\""
Jul 07 16:56:20.988002 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:20.987986    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"kube-root-ca.crt\""
Jul 07 16:56:20.988093 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:20.988060    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-3c33bd\"/\"sub-test-model-3c33bd-kserve-self-signed-certs\""
Jul 07 16:56:20.997558 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:20.997539    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"]
Jul 07 16:56:21.028676 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.028653    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:56:21.071544 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.071513    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d68w4\" (UniqueName: \"kubernetes.io/projected/ee58fceb-3a74-4f46-917e-63dee216e619-kube-api-access-d68w4\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.071676 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.071555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-home\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.071676 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.071581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-tmp-dir\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.071676 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.071653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-dshm\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.071791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.071710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-model-cache\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.071791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.071752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee58fceb-3a74-4f46-917e-63dee216e619-tls-certs\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.172998 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.172960    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d68w4\" (UniqueName: \"kubernetes.io/projected/ee58fceb-3a74-4f46-917e-63dee216e619-kube-api-access-d68w4\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.172998 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.173002    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-home\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.173238 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.173020    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-tmp-dir\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.173238 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.173053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-dshm\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.173238 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.173080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-model-cache\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.173238 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.173109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee58fceb-3a74-4f46-917e-63dee216e619-tls-certs\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.173451 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.173386    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-home\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.173530 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.173505    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-model-cache\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.173582 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.173535    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-tmp-dir\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.175300 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.175281    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-dshm\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.175542 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.175525    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee58fceb-3a74-4f46-917e-63dee216e619-tls-certs\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.183001 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.182982    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d68w4\" (UniqueName: \"kubernetes.io/projected/ee58fceb-3a74-4f46-917e-63dee216e619-kube-api-access-d68w4\") pod \"sub-test-model-3c33bd-kserve-6785675c6c-hmknh\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") " pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.293415 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.293330    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:21.426932 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.426910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"]
Jul 07 16:56:21.428750 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:56:21.428723    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee58fceb_3a74_4f46_917e_63dee216e619.slice/crio-c486ac46cc0dcfd67e0c9f158c4d3f0a8a14ad34c25cfb1892fe5fd3d1d8e182 WatchSource:0}: Error finding container c486ac46cc0dcfd67e0c9f158c4d3f0a8a14ad34c25cfb1892fe5fd3d1d8e182: Status 404 returned error can't find the container with id c486ac46cc0dcfd67e0c9f158c4d3f0a8a14ad34c25cfb1892fe5fd3d1d8e182
Jul 07 16:56:21.716209 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.716174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh" event={"ID":"ee58fceb-3a74-4f46-917e-63dee216e619","Type":"ContainerStarted","Data":"301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c"}
Jul 07 16:56:21.716387 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.716221    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh" event={"ID":"ee58fceb-3a74-4f46-917e-63dee216e619","Type":"ContainerStarted","Data":"c486ac46cc0dcfd67e0c9f158c4d3f0a8a14ad34c25cfb1892fe5fd3d1d8e182"}
Jul 07 16:56:21.738513 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:21.738468    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh" podStartSLOduration=1.738444557 podStartE2EDuration="1.738444557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:56:21.73718342 +0000 UTC m=+2275.091468679" watchObservedRunningTime="2026-07-07 16:56:21.738444557 +0000 UTC m=+2275.092729807"
Jul 07 16:56:31.294141 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:31.294103    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:31.294141 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:31.294152    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:31.306317 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:31.306294    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:56:31.770079 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:56:31.770050    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:57:09.306903 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:09.306868    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:10.360847 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:10.360811    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"]
Jul 07 16:57:10.421141 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:10.421102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:14.580384 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.580354    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"]
Jul 07 16:57:14.583525 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.583508    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.587727 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.587703    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"openshift-service-ca.crt\""
Jul 07 16:57:14.587897 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.587705    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"rate-test-model-9926c0-kserve-self-signed-certs\""
Jul 07 16:57:14.587897 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.587706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"default-dockercfg-w5pzn\""
Jul 07 16:57:14.587897 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.587776    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9926c0\"/\"kube-root-ca.crt\""
Jul 07 16:57:14.598051 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.598026    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"]
Jul 07 16:57:14.615396 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.615375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:14.719475 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.719436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-dshm\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.719475 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.719474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bafdcb1d-795a-4a1d-ac00-d26087027c42-tls-certs\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.719681 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.719493    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6ndd\" (UniqueName: \"kubernetes.io/projected/bafdcb1d-795a-4a1d-ac00-d26087027c42-kube-api-access-k6ndd\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.719681 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.719512    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-tmp-dir\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.719681 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.719597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-model-cache\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.719681 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.719620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-home\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.820179 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.820144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-model-cache\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.820179 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.820185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-home\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.820440 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.820216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-dshm\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.820440 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.820233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bafdcb1d-795a-4a1d-ac00-d26087027c42-tls-certs\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.820440 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.820250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6ndd\" (UniqueName: \"kubernetes.io/projected/bafdcb1d-795a-4a1d-ac00-d26087027c42-kube-api-access-k6ndd\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.820440 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.820276    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-tmp-dir\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.820653 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.820545    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-home\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.820653 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.820604    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-model-cache\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.820741 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.820702    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-tmp-dir\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.822602 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.822579    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-dshm\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.822850 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.822815    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bafdcb1d-795a-4a1d-ac00-d26087027c42-tls-certs\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.830056 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.830034    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6ndd\" (UniqueName: \"kubernetes.io/projected/bafdcb1d-795a-4a1d-ac00-d26087027c42-kube-api-access-k6ndd\") pod \"rate-test-model-9926c0-kserve-59574f6c55-m29f2\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") " pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:14.892469 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:14.892444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:15.020509 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:15.020477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"]
Jul 07 16:57:15.024157 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:57:15.024118    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbafdcb1d_795a_4a1d_ac00_d26087027c42.slice/crio-a01588ae5f8b23b9afe189c7143e96c9e9f9c4a04f4b54c75ca72476349a61f9 WatchSource:0}: Error finding container a01588ae5f8b23b9afe189c7143e96c9e9f9c4a04f4b54c75ca72476349a61f9: Status 404 returned error can't find the container with id a01588ae5f8b23b9afe189c7143e96c9e9f9c4a04f4b54c75ca72476349a61f9
Jul 07 16:57:15.951487 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:15.951453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2" event={"ID":"bafdcb1d-795a-4a1d-ac00-d26087027c42","Type":"ContainerStarted","Data":"37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747"}
Jul 07 16:57:15.951487 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:15.951493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2" event={"ID":"bafdcb1d-795a-4a1d-ac00-d26087027c42","Type":"ContainerStarted","Data":"a01588ae5f8b23b9afe189c7143e96c9e9f9c4a04f4b54c75ca72476349a61f9"}
Jul 07 16:57:15.970164 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:15.970117    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2" podStartSLOduration=1.970103066 podStartE2EDuration="1.970103066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:57:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:57:15.969117441 +0000 UTC m=+2329.323402690" watchObservedRunningTime="2026-07-07 16:57:15.970103066 +0000 UTC m=+2329.324388313"
Jul 07 16:57:24.892664 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:24.892571    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:24.892664 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:24.892629    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:24.905084 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:24.905059    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:25.000036 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.000010    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:57:25.380354 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.380322    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh" podUID="ee58fceb-3a74-4f46-917e-63dee216e619" containerName="main" containerID="cri-o://301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c" gracePeriod=45
Jul 07 16:57:25.620461 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.620437    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:57:25.719866 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.719777    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-home\") pod \"ee58fceb-3a74-4f46-917e-63dee216e619\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") "
Jul 07 16:57:25.719866 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.719862    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d68w4\" (UniqueName: \"kubernetes.io/projected/ee58fceb-3a74-4f46-917e-63dee216e619-kube-api-access-d68w4\") pod \"ee58fceb-3a74-4f46-917e-63dee216e619\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") "
Jul 07 16:57:25.720114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.719880    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-dshm\") pod \"ee58fceb-3a74-4f46-917e-63dee216e619\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") "
Jul 07 16:57:25.720114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.719897    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-model-cache\") pod \"ee58fceb-3a74-4f46-917e-63dee216e619\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") "
Jul 07 16:57:25.720114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.719965    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-tmp-dir\") pod \"ee58fceb-3a74-4f46-917e-63dee216e619\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") "
Jul 07 16:57:25.720114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.720033    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee58fceb-3a74-4f46-917e-63dee216e619-tls-certs\") pod \"ee58fceb-3a74-4f46-917e-63dee216e619\" (UID: \"ee58fceb-3a74-4f46-917e-63dee216e619\") "
Jul 07 16:57:25.720114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.720081    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-home" (OuterVolumeSpecName: "home") pod "ee58fceb-3a74-4f46-917e-63dee216e619" (UID: "ee58fceb-3a74-4f46-917e-63dee216e619"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:25.720375 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.720209    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ee58fceb-3a74-4f46-917e-63dee216e619" (UID: "ee58fceb-3a74-4f46-917e-63dee216e619"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:25.720375 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.720229    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-model-cache" (OuterVolumeSpecName: "model-cache") pod "ee58fceb-3a74-4f46-917e-63dee216e619" (UID: "ee58fceb-3a74-4f46-917e-63dee216e619"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:25.720375 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.720347    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-model-cache\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:57:25.720375 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.720367    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-tmp-dir\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:57:25.720511 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.720380    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-home\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:57:25.722133 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.722095    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-dshm" (OuterVolumeSpecName: "dshm") pod "ee58fceb-3a74-4f46-917e-63dee216e619" (UID: "ee58fceb-3a74-4f46-917e-63dee216e619"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:57:25.722133 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.722102    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee58fceb-3a74-4f46-917e-63dee216e619-kube-api-access-d68w4" (OuterVolumeSpecName: "kube-api-access-d68w4") pod "ee58fceb-3a74-4f46-917e-63dee216e619" (UID: "ee58fceb-3a74-4f46-917e-63dee216e619"). InnerVolumeSpecName "kube-api-access-d68w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:57:25.722306 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.722224    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee58fceb-3a74-4f46-917e-63dee216e619-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ee58fceb-3a74-4f46-917e-63dee216e619" (UID: "ee58fceb-3a74-4f46-917e-63dee216e619"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:57:25.821669 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.821631    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d68w4\" (UniqueName: \"kubernetes.io/projected/ee58fceb-3a74-4f46-917e-63dee216e619-kube-api-access-d68w4\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:57:25.821669 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.821663    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee58fceb-3a74-4f46-917e-63dee216e619-dshm\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:57:25.821902 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.821677    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee58fceb-3a74-4f46-917e-63dee216e619-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:57:25.994207 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.994120    2563 generic.go:356] "Generic (PLEG): container finished" podID="ee58fceb-3a74-4f46-917e-63dee216e619" containerID="301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c" exitCode=0
Jul 07 16:57:25.994207 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.994161    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"
Jul 07 16:57:25.994716 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.994201    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh" event={"ID":"ee58fceb-3a74-4f46-917e-63dee216e619","Type":"ContainerDied","Data":"301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c"}
Jul 07 16:57:25.994716 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.994254    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh" event={"ID":"ee58fceb-3a74-4f46-917e-63dee216e619","Type":"ContainerDied","Data":"c486ac46cc0dcfd67e0c9f158c4d3f0a8a14ad34c25cfb1892fe5fd3d1d8e182"}
Jul 07 16:57:25.994716 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:25.994275    2563 scope.go:117] "RemoveContainer" containerID="301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c"
Jul 07 16:57:26.002864 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:26.002849    2563 scope.go:117] "RemoveContainer" containerID="301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c"
Jul 07 16:57:26.003144 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:57:26.003126    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c\": container with ID starting with 301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c not found: ID does not exist" containerID="301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c"
Jul 07 16:57:26.003196 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:26.003152    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c"} err="failed to get container status \"301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c\": rpc error: code = NotFound desc = could not find container \"301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c\": container with ID starting with 301a659867bf0719af87318fd10dec2dea05be78988b8ff4b13c212cb63c941c not found: ID does not exist"
Jul 07 16:57:26.015792 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:26.015766    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"]
Jul 07 16:57:26.023927 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:26.023909    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-3c33bd/sub-test-model-3c33bd-kserve-6785675c6c-hmknh"]
Jul 07 16:57:27.386871 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:27.386822    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee58fceb-3a74-4f46-917e-63dee216e619" path="/var/lib/kubelet/pods/ee58fceb-3a74-4f46-917e-63dee216e619/volumes"
Jul 07 16:57:49.292136 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:49.292093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:49.390123 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:49.390087    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:57:49.535108 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:57:49.535073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:14.120307 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:14.120276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:14.222038 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:14.222007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:21.254280 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:21.254241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:21.356023 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:21.355991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:50.286952 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:50.286876    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"]
Jul 07 16:58:50.359809 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:50.359775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:51.161522 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:51.161493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:52.193463 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:52.193427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:52.614287 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:52.614256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:52.826997 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:52.826968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:52.976697 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:52.976612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:53.181293 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:53.181265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:58:57.675984 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:58:57.675945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:05.307694 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.307625    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2" podUID="bafdcb1d-795a-4a1d-ac00-d26087027c42" containerName="main" containerID="cri-o://37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747" gracePeriod=45
Jul 07 16:59:05.556354 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.556326    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:59:05.675928 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.675902    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-dshm\") pod \"bafdcb1d-795a-4a1d-ac00-d26087027c42\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") "
Jul 07 16:59:05.676123 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.675941    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6ndd\" (UniqueName: \"kubernetes.io/projected/bafdcb1d-795a-4a1d-ac00-d26087027c42-kube-api-access-k6ndd\") pod \"bafdcb1d-795a-4a1d-ac00-d26087027c42\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") "
Jul 07 16:59:05.676123 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.675988    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-home\") pod \"bafdcb1d-795a-4a1d-ac00-d26087027c42\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") "
Jul 07 16:59:05.676123 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.676018    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bafdcb1d-795a-4a1d-ac00-d26087027c42-tls-certs\") pod \"bafdcb1d-795a-4a1d-ac00-d26087027c42\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") "
Jul 07 16:59:05.676123 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.676095    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-model-cache\") pod \"bafdcb1d-795a-4a1d-ac00-d26087027c42\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") "
Jul 07 16:59:05.676340 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.676125    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-tmp-dir\") pod \"bafdcb1d-795a-4a1d-ac00-d26087027c42\" (UID: \"bafdcb1d-795a-4a1d-ac00-d26087027c42\") "
Jul 07 16:59:05.676340 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.676264    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-home" (OuterVolumeSpecName: "home") pod "bafdcb1d-795a-4a1d-ac00-d26087027c42" (UID: "bafdcb1d-795a-4a1d-ac00-d26087027c42"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:05.676453 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.676378    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-model-cache" (OuterVolumeSpecName: "model-cache") pod "bafdcb1d-795a-4a1d-ac00-d26087027c42" (UID: "bafdcb1d-795a-4a1d-ac00-d26087027c42"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:05.676453 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.676389    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-home\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:05.676536 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.676461    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bafdcb1d-795a-4a1d-ac00-d26087027c42" (UID: "bafdcb1d-795a-4a1d-ac00-d26087027c42"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:05.677900 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.677878    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-dshm" (OuterVolumeSpecName: "dshm") pod "bafdcb1d-795a-4a1d-ac00-d26087027c42" (UID: "bafdcb1d-795a-4a1d-ac00-d26087027c42"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:05.678011 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.677988    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bafdcb1d-795a-4a1d-ac00-d26087027c42-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bafdcb1d-795a-4a1d-ac00-d26087027c42" (UID: "bafdcb1d-795a-4a1d-ac00-d26087027c42"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 16:59:05.678067 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.678031    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bafdcb1d-795a-4a1d-ac00-d26087027c42-kube-api-access-k6ndd" (OuterVolumeSpecName: "kube-api-access-k6ndd") pod "bafdcb1d-795a-4a1d-ac00-d26087027c42" (UID: "bafdcb1d-795a-4a1d-ac00-d26087027c42"). InnerVolumeSpecName "kube-api-access-k6ndd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:59:05.777612 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.777583    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-dshm\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:05.777612 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.777608    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6ndd\" (UniqueName: \"kubernetes.io/projected/bafdcb1d-795a-4a1d-ac00-d26087027c42-kube-api-access-k6ndd\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:05.777784 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.777623    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bafdcb1d-795a-4a1d-ac00-d26087027c42-tls-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:05.777784 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.777636    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-model-cache\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:05.777784 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:05.777647    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bafdcb1d-795a-4a1d-ac00-d26087027c42-tmp-dir\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:06.410791 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:06.410757    2563 generic.go:356] "Generic (PLEG): container finished" podID="bafdcb1d-795a-4a1d-ac00-d26087027c42" containerID="37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747" exitCode=0
Jul 07 16:59:06.411296 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:06.410799    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"
Jul 07 16:59:06.411296 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:06.410854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2" event={"ID":"bafdcb1d-795a-4a1d-ac00-d26087027c42","Type":"ContainerDied","Data":"37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747"}
Jul 07 16:59:06.411296 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:06.410898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2" event={"ID":"bafdcb1d-795a-4a1d-ac00-d26087027c42","Type":"ContainerDied","Data":"a01588ae5f8b23b9afe189c7143e96c9e9f9c4a04f4b54c75ca72476349a61f9"}
Jul 07 16:59:06.411296 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:06.410916    2563 scope.go:117] "RemoveContainer" containerID="37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747"
Jul 07 16:59:06.419904 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:06.419884    2563 scope.go:117] "RemoveContainer" containerID="37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747"
Jul 07 16:59:06.420169 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:59:06.420138    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747\": container with ID starting with 37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747 not found: ID does not exist" containerID="37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747"
Jul 07 16:59:06.420266 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:06.420167    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747"} err="failed to get container status \"37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747\": rpc error: code = NotFound desc = could not find container \"37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747\": container with ID starting with 37c4bdca5b5af067b5bf5ced7cb3d47f8ac3dcca0f37165a45f4ca3c38e5f747 not found: ID does not exist"
Jul 07 16:59:06.437707 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:06.437674    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"]
Jul 07 16:59:06.452250 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:06.452227    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9926c0/rate-test-model-9926c0-kserve-59574f6c55-m29f2"]
Jul 07 16:59:07.394664 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:07.394627    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bafdcb1d-795a-4a1d-ac00-d26087027c42" path="/var/lib/kubelet/pods/bafdcb1d-795a-4a1d-ac00-d26087027c42/volumes"
Jul 07 16:59:29.003035 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:29.003001    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:35.258244 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:35.258213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:35.540806 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:35.540731    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"]
Jul 07 16:59:35.540982 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:35.540956    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy" containerID="cri-o://732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919" gracePeriod=30
Jul 07 16:59:35.562262 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:35.562238    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:35.770676 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:35.770644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:35.949334 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:35.949306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:36.341400 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:36.341311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:36.497789 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:36.497758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:36.596537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:36.596458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:36.789953 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:36.789903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:39.499247 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:39.499209    2563 patch_prober.go:28] interesting pod/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 16:59:39.499696 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:39.499266    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 16:59:40.780694 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.780668    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:59:40.862223 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862187    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-socket\") pod \"cd576be5-9833-4f23-be26-cf06e9d51275\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") "
Jul 07 16:59:40.862368 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862256    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8snnw\" (UniqueName: \"kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-kube-api-access-8snnw\") pod \"cd576be5-9833-4f23-be26-cf06e9d51275\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") "
Jul 07 16:59:40.862368 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862305    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd576be5-9833-4f23-be26-cf06e9d51275-istio-podinfo\") pod \"cd576be5-9833-4f23-be26-cf06e9d51275\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") "
Jul 07 16:59:40.862368 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862341    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd576be5-9833-4f23-be26-cf06e9d51275-istiod-ca-cert\") pod \"cd576be5-9833-4f23-be26-cf06e9d51275\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") "
Jul 07 16:59:40.862510 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862377    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-data\") pod \"cd576be5-9833-4f23-be26-cf06e9d51275\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") "
Jul 07 16:59:40.862510 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862415    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-istio-token\") pod \"cd576be5-9833-4f23-be26-cf06e9d51275\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") "
Jul 07 16:59:40.862510 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862452    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-certs\") pod \"cd576be5-9833-4f23-be26-cf06e9d51275\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") "
Jul 07 16:59:40.862510 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862477    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-envoy\") pod \"cd576be5-9833-4f23-be26-cf06e9d51275\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") "
Jul 07 16:59:40.862510 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862497    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd576be5-9833-4f23-be26-cf06e9d51275" (UID: "cd576be5-9833-4f23-be26-cf06e9d51275"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:40.862766 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862512    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-credential-socket\") pod \"cd576be5-9833-4f23-be26-cf06e9d51275\" (UID: \"cd576be5-9833-4f23-be26-cf06e9d51275\") "
Jul 07 16:59:40.862766 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862727    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd576be5-9833-4f23-be26-cf06e9d51275" (UID: "cd576be5-9833-4f23-be26-cf06e9d51275"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:40.862906 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862809    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:40.862906 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862810    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd576be5-9833-4f23-be26-cf06e9d51275-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd576be5-9833-4f23-be26-cf06e9d51275" (UID: "cd576be5-9833-4f23-be26-cf06e9d51275"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:59:40.862906 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862826    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:40.863048 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.862944    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd576be5-9833-4f23-be26-cf06e9d51275" (UID: "cd576be5-9833-4f23-be26-cf06e9d51275"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:40.863380 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.863351    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd576be5-9833-4f23-be26-cf06e9d51275" (UID: "cd576be5-9833-4f23-be26-cf06e9d51275"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:40.865050 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.865030    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-kube-api-access-8snnw" (OuterVolumeSpecName: "kube-api-access-8snnw") pod "cd576be5-9833-4f23-be26-cf06e9d51275" (UID: "cd576be5-9833-4f23-be26-cf06e9d51275"). InnerVolumeSpecName "kube-api-access-8snnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:59:40.865112 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.865035    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd576be5-9833-4f23-be26-cf06e9d51275-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd576be5-9833-4f23-be26-cf06e9d51275" (UID: "cd576be5-9833-4f23-be26-cf06e9d51275"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:59:40.865195 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.865177    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd576be5-9833-4f23-be26-cf06e9d51275" (UID: "cd576be5-9833-4f23-be26-cf06e9d51275"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:59:40.865497 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.865477    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd576be5-9833-4f23-be26-cf06e9d51275" (UID: "cd576be5-9833-4f23-be26-cf06e9d51275"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:40.963797 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.963770    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:40.963797 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.963791    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:40.963797 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.963800    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:40.964003 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.963810    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8snnw\" (UniqueName: \"kubernetes.io/projected/cd576be5-9833-4f23-be26-cf06e9d51275-kube-api-access-8snnw\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:40.964003 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.963819    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd576be5-9833-4f23-be26-cf06e9d51275-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:40.964003 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.963828    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd576be5-9833-4f23-be26-cf06e9d51275-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:40.964003 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:40.963851    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd576be5-9833-4f23-be26-cf06e9d51275-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:41.562819 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.562784    2563 generic.go:356] "Generic (PLEG): container finished" podID="cd576be5-9833-4f23-be26-cf06e9d51275" containerID="732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919" exitCode=0
Jul 07 16:59:41.563013 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.562855    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"
Jul 07 16:59:41.563013 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.562861    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" event={"ID":"cd576be5-9833-4f23-be26-cf06e9d51275","Type":"ContainerDied","Data":"732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919"}
Jul 07 16:59:41.563013 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.562905    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c" event={"ID":"cd576be5-9833-4f23-be26-cf06e9d51275","Type":"ContainerDied","Data":"a06458eaee377dc3072e4210b6f45eba67981a34924ac97c1a2961fa61a2edb7"}
Jul 07 16:59:41.563013 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.562928    2563 scope.go:117] "RemoveContainer" containerID="732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919"
Jul 07 16:59:41.576191 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.576175    2563 scope.go:117] "RemoveContainer" containerID="e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2"
Jul 07 16:59:41.583867 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.583825    2563 scope.go:117] "RemoveContainer" containerID="732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919"
Jul 07 16:59:41.584151 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:59:41.584129    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919\": container with ID starting with 732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919 not found: ID does not exist" containerID="732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919"
Jul 07 16:59:41.584221 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.584158    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919"} err="failed to get container status \"732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919\": rpc error: code = NotFound desc = could not find container \"732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919\": container with ID starting with 732842f9618052d472ed8330a026252c85e181aeeb35f407265869f5da523919 not found: ID does not exist"
Jul 07 16:59:41.584221 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.584175    2563 scope.go:117] "RemoveContainer" containerID="e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2"
Jul 07 16:59:41.584430 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:59:41.584410    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2\": container with ID starting with e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2 not found: ID does not exist" containerID="e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2"
Jul 07 16:59:41.584488 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.584440    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2"} err="failed to get container status \"e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2\": rpc error: code = NotFound desc = could not find container \"e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2\": container with ID starting with e8f23df7c393d0a1c4589eebe694a2a4805951aecdc411b406d3d752c6363fb2 not found: ID does not exist"
Jul 07 16:59:41.585047 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.585029    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"]
Jul 07 16:59:41.588989 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:41.588959    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9926c0-openshift-default-77f846b8c-jh44c"]
Jul 07 16:59:42.289387 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:42.289357    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:42.391971 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:42.391944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:42.569598 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:42.569516    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"]
Jul 07 16:59:42.569766 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:42.569729    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy" containerID="cri-o://244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f" gracePeriod=30
Jul 07 16:59:42.585559 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:42.585534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:42.799126 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:42.799090    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:43.186665 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:43.186635    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f69db59d9-5q4hc_55bbb774-91d5-4835-a1ec-45dc26bce916/authorino/0.log"
Jul 07 16:59:43.386243 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:43.386204    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" path="/var/lib/kubelet/pods/cd576be5-9833-4f23-be26-cf06e9d51275/volumes"
Jul 07 16:59:47.810877 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.810848    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:59:47.925109 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925075    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d396a85e-b961-443a-b3b7-94aeef57831b-istio-podinfo\") pod \"d396a85e-b961-443a-b3b7-94aeef57831b\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") "
Jul 07 16:59:47.925314 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925123    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-data\") pod \"d396a85e-b961-443a-b3b7-94aeef57831b\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") "
Jul 07 16:59:47.925314 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925147    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-envoy\") pod \"d396a85e-b961-443a-b3b7-94aeef57831b\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") "
Jul 07 16:59:47.925314 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925167    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-credential-socket\") pod \"d396a85e-b961-443a-b3b7-94aeef57831b\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") "
Jul 07 16:59:47.925314 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925205    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-istio-token\") pod \"d396a85e-b961-443a-b3b7-94aeef57831b\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") "
Jul 07 16:59:47.925314 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925244    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-certs\") pod \"d396a85e-b961-443a-b3b7-94aeef57831b\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") "
Jul 07 16:59:47.925314 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925270    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d396a85e-b961-443a-b3b7-94aeef57831b-istiod-ca-cert\") pod \"d396a85e-b961-443a-b3b7-94aeef57831b\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") "
Jul 07 16:59:47.925314 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925301    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-socket\") pod \"d396a85e-b961-443a-b3b7-94aeef57831b\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") "
Jul 07 16:59:47.925684 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925352    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rxqz\" (UniqueName: \"kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-kube-api-access-4rxqz\") pod \"d396a85e-b961-443a-b3b7-94aeef57831b\" (UID: \"d396a85e-b961-443a-b3b7-94aeef57831b\") "
Jul 07 16:59:47.925684 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925576    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d396a85e-b961-443a-b3b7-94aeef57831b" (UID: "d396a85e-b961-443a-b3b7-94aeef57831b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:47.925923 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925863    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d396a85e-b961-443a-b3b7-94aeef57831b" (UID: "d396a85e-b961-443a-b3b7-94aeef57831b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:47.925923 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925912    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d396a85e-b961-443a-b3b7-94aeef57831b" (UID: "d396a85e-b961-443a-b3b7-94aeef57831b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:47.926133 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925755    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d396a85e-b961-443a-b3b7-94aeef57831b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d396a85e-b961-443a-b3b7-94aeef57831b" (UID: "d396a85e-b961-443a-b3b7-94aeef57831b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 16:59:47.926133 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.925986    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d396a85e-b961-443a-b3b7-94aeef57831b" (UID: "d396a85e-b961-443a-b3b7-94aeef57831b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:47.927446 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.927424    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d396a85e-b961-443a-b3b7-94aeef57831b" (UID: "d396a85e-b961-443a-b3b7-94aeef57831b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:59:47.927537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.927448    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d396a85e-b961-443a-b3b7-94aeef57831b" (UID: "d396a85e-b961-443a-b3b7-94aeef57831b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 16:59:47.927537 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.927461    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d396a85e-b961-443a-b3b7-94aeef57831b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d396a85e-b961-443a-b3b7-94aeef57831b" (UID: "d396a85e-b961-443a-b3b7-94aeef57831b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 16:59:47.927622 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:47.927603    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-kube-api-access-4rxqz" (OuterVolumeSpecName: "kube-api-access-4rxqz") pod "d396a85e-b961-443a-b3b7-94aeef57831b" (UID: "d396a85e-b961-443a-b3b7-94aeef57831b"). InnerVolumeSpecName "kube-api-access-4rxqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 16:59:48.026337 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.026293    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rxqz\" (UniqueName: \"kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-kube-api-access-4rxqz\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:48.026337 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.026330    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d396a85e-b961-443a-b3b7-94aeef57831b-istio-podinfo\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:48.026337 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.026341    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-data\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:48.026337 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.026349    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-istio-envoy\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:48.026627 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.026358    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-credential-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:48.026627 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.026366    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d396a85e-b961-443a-b3b7-94aeef57831b-istio-token\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:48.026627 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.026374    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-certs\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:48.026627 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.026381    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d396a85e-b961-443a-b3b7-94aeef57831b-istiod-ca-cert\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:48.026627 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.026388    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d396a85e-b961-443a-b3b7-94aeef57831b-workload-socket\") on node \"ip-10-0-136-99.ec2.internal\" DevicePath \"\""
Jul 07 16:59:48.536029 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.535993    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tfcgw_9df4643c-39c8-42cc-8d3b-2501657cfc3e/server/0.log"
Jul 07 16:59:48.592991 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.592958    2563 generic.go:356] "Generic (PLEG): container finished" podID="d396a85e-b961-443a-b3b7-94aeef57831b" containerID="244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f" exitCode=0
Jul 07 16:59:48.593136 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.593020    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"
Jul 07 16:59:48.593136 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.593049    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" event={"ID":"d396a85e-b961-443a-b3b7-94aeef57831b","Type":"ContainerDied","Data":"244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f"}
Jul 07 16:59:48.593136 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.593106    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd" event={"ID":"d396a85e-b961-443a-b3b7-94aeef57831b","Type":"ContainerDied","Data":"cab51d8cad3a7d67cedc4b7128794bd11f669de46a4953aa251e1b9e63202bb7"}
Jul 07 16:59:48.593136 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.593129    2563 scope.go:117] "RemoveContainer" containerID="244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f"
Jul 07 16:59:48.601651 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.601636    2563 scope.go:117] "RemoveContainer" containerID="71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01"
Jul 07 16:59:48.609182 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.609164    2563 scope.go:117] "RemoveContainer" containerID="244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f"
Jul 07 16:59:48.609414 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:59:48.609394    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f\": container with ID starting with 244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f not found: ID does not exist" containerID="244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f"
Jul 07 16:59:48.609491 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.609425    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f"} err="failed to get container status \"244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f\": rpc error: code = NotFound desc = could not find container \"244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f\": container with ID starting with 244df98318a76b0d46e61557c1e5e26333bce5a2b25912e37c28ed13e426592f not found: ID does not exist"
Jul 07 16:59:48.609491 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.609448    2563 scope.go:117] "RemoveContainer" containerID="71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01"
Jul 07 16:59:48.609667 ip-10-0-136-99 kubenswrapper[2563]: E0707 16:59:48.609651    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01\": container with ID starting with 71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01 not found: ID does not exist" containerID="71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01"
Jul 07 16:59:48.609707 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.609672    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01"} err="failed to get container status \"71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01\": rpc error: code = NotFound desc = could not find container \"71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01\": container with ID starting with 71ae4254a4c4134bae9a4f7facf3cd20e023d91f94a1af208d05dd2e6a848c01 not found: ID does not exist"
Jul 07 16:59:48.618081 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.618059    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"]
Jul 07 16:59:48.624555 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.624537    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-3c33bd-openshift-default-79bd4ddbbc-6f2cd"]
Jul 07 16:59:48.899623 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.899599    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f64778974-5nz45_70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0/copy-manifests/0.log"
Jul 07 16:59:48.912956 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:48.912936    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f64778974-5nz45_70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0/manager/0.log"
Jul 07 16:59:49.386404 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:49.386374    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" path="/var/lib/kubelet/pods/d396a85e-b961-443a-b3b7-94aeef57831b/volumes"
Jul 07 16:59:50.452262 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:50.452230    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f69db59d9-5q4hc_55bbb774-91d5-4835-a1ec-45dc26bce916/authorino/0.log"
Jul 07 16:59:51.638118 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:51.638086    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46mzj2_f842bd1b-ec8f-4baf-b042-90917b33dea7/istio-proxy/0.log"
Jul 07 16:59:51.878975 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:51.878945    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbbdb79bb-7txjg_201979d1-95ba-41bc-9ec4-a93886cce720/kube-auth-proxy/0.log"
Jul 07 16:59:53.131294 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:53.131259    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db6h9hc_7b8dea16-7f86-4ff4-b82d-3ea724ffbf52/main/0.log"
Jul 07 16:59:53.358184 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:53.358156    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-5m6fd_6375b27b-9c80-449e-967b-07ef9304331c/main/0.log"
Jul 07 16:59:57.487957 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.487922    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-948xd/must-gather-45lw5"]
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488210    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488221    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488230    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee58fceb-3a74-4f46-917e-63dee216e619" containerName="main"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488236    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee58fceb-3a74-4f46-917e-63dee216e619" containerName="main"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488244    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488251    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488260    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488265    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488271    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488275    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488281    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bafdcb1d-795a-4a1d-ac00-d26087027c42" containerName="main"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488285    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bafdcb1d-795a-4a1d-ac00-d26087027c42" containerName="main"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488330    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488336    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bafdcb1d-795a-4a1d-ac00-d26087027c42" containerName="main"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488341    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488348    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee58fceb-3a74-4f46-917e-63dee216e619" containerName="main"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488354    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd576be5-9833-4f23-be26-cf06e9d51275" containerName="istio-proxy"
Jul 07 16:59:57.488379 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.488360    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d396a85e-b961-443a-b3b7-94aeef57831b" containerName="istio-proxy"
Jul 07 16:59:57.492878 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.492855    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-948xd/must-gather-45lw5"
Jul 07 16:59:57.498114 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.498091    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-948xd\"/\"kube-root-ca.crt\""
Jul 07 16:59:57.499191 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.499168    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-948xd\"/\"openshift-service-ca.crt\""
Jul 07 16:59:57.499191 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.499180    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-948xd\"/\"default-dockercfg-6wmwk\""
Jul 07 16:59:57.503061 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.503025    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-948xd/must-gather-45lw5"]
Jul 07 16:59:57.506629 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.506606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:57.604674 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.604636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log" limit=1024
Jul 07 16:59:57.609704 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.609679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww5jv\" (UniqueName: \"kubernetes.io/projected/137677cf-4928-44d0-9dd6-d5e866931b23-kube-api-access-ww5jv\") pod \"must-gather-45lw5\" (UID: \"137677cf-4928-44d0-9dd6-d5e866931b23\") " pod="openshift-must-gather-948xd/must-gather-45lw5"
Jul 07 16:59:57.609786 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.609743    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/137677cf-4928-44d0-9dd6-d5e866931b23-must-gather-output\") pod \"must-gather-45lw5\" (UID: \"137677cf-4928-44d0-9dd6-d5e866931b23\") " pod="openshift-must-gather-948xd/must-gather-45lw5"
Jul 07 16:59:57.711058 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.711017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/137677cf-4928-44d0-9dd6-d5e866931b23-must-gather-output\") pod \"must-gather-45lw5\" (UID: \"137677cf-4928-44d0-9dd6-d5e866931b23\") " pod="openshift-must-gather-948xd/must-gather-45lw5"
Jul 07 16:59:57.711217 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.711080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww5jv\" (UniqueName: \"kubernetes.io/projected/137677cf-4928-44d0-9dd6-d5e866931b23-kube-api-access-ww5jv\") pod \"must-gather-45lw5\" (UID: \"137677cf-4928-44d0-9dd6-d5e866931b23\") " pod="openshift-must-gather-948xd/must-gather-45lw5"
Jul 07 16:59:57.711378 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.711355    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/137677cf-4928-44d0-9dd6-d5e866931b23-must-gather-output\") pod \"must-gather-45lw5\" (UID: \"137677cf-4928-44d0-9dd6-d5e866931b23\") " pod="openshift-must-gather-948xd/must-gather-45lw5"
Jul 07 16:59:57.720411 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.720384    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww5jv\" (UniqueName: \"kubernetes.io/projected/137677cf-4928-44d0-9dd6-d5e866931b23-kube-api-access-ww5jv\") pod \"must-gather-45lw5\" (UID: \"137677cf-4928-44d0-9dd6-d5e866931b23\") " pod="openshift-must-gather-948xd/must-gather-45lw5"
Jul 07 16:59:57.803116 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.803029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-948xd/must-gather-45lw5"
Jul 07 16:59:57.939828 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.939803    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-948xd/must-gather-45lw5"]
Jul 07 16:59:57.942211 ip-10-0-136-99 kubenswrapper[2563]: W0707 16:59:57.942182    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod137677cf_4928_44d0_9dd6_d5e866931b23.slice/crio-4f178bab76a61075956e04b4857e8b5343f4c6028a58f04868c04fbca8de86f5 WatchSource:0}: Error finding container 4f178bab76a61075956e04b4857e8b5343f4c6028a58f04868c04fbca8de86f5: Status 404 returned error can't find the container with id 4f178bab76a61075956e04b4857e8b5343f4c6028a58f04868c04fbca8de86f5
Jul 07 16:59:57.944610 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:57.944589    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 16:59:58.636226 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:58.636192    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-948xd/must-gather-45lw5" event={"ID":"137677cf-4928-44d0-9dd6-d5e866931b23","Type":"ContainerStarted","Data":"4f178bab76a61075956e04b4857e8b5343f4c6028a58f04868c04fbca8de86f5"}
Jul 07 16:59:59.641697 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:59.641658    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-948xd/must-gather-45lw5" event={"ID":"137677cf-4928-44d0-9dd6-d5e866931b23","Type":"ContainerStarted","Data":"73fba0903d06b807741ddb58caf3bcefba8bf699e62bfeed12e056b55ffb7c65"}
Jul 07 16:59:59.642135 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:59.641709    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-948xd/must-gather-45lw5" event={"ID":"137677cf-4928-44d0-9dd6-d5e866931b23","Type":"ContainerStarted","Data":"43d45d16045e541ff2ee5899b7db6228426f7d6d091f21e47fd2b5a2dc94890e"}
Jul 07 16:59:59.672071 ip-10-0-136-99 kubenswrapper[2563]: I0707 16:59:59.672017    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-948xd/must-gather-45lw5" podStartSLOduration=1.8481729279999999 podStartE2EDuration="2.672000585s" totalImagesPullingTime="823.827657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:59:59.670722409 +0000 UTC m=+2493.025007659" watchObservedRunningTime="2026-07-07 16:59:59.672000585 +0000 UTC m=+2493.026285833"
Jul 07 17:00:00.493885 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:00.493832    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t8nzc_8e12111d-b924-495e-b09b-7c40400657d8/global-pull-secret-syncer/0.log"
Jul 07 17:00:00.620858 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:00.620818    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6djm2_da99183f-c36a-45b4-aafd-893a7fb07e1c/konnectivity-agent/0.log"
Jul 07 17:00:00.774677 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:00.774589    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-99.ec2.internal_e71a3a3460c87775c4ea31484e344c7e/haproxy/0.log"
Jul 07 17:00:05.695878 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:05.695672    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f69db59d9-5q4hc_55bbb774-91d5-4835-a1ec-45dc26bce916/authorino/0.log"
Jul 07 17:00:08.459241 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:08.459212    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tvts_7b4b2983-fdef-4012-907a-9c0b17d70647/node-exporter/0.log"
Jul 07 17:00:08.513353 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:08.513322    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tvts_7b4b2983-fdef-4012-907a-9c0b17d70647/kube-rbac-proxy/0.log"
Jul 07 17:00:08.569243 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:08.569215    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9tvts_7b4b2983-fdef-4012-907a-9c0b17d70647/init-textfile/0.log"
Jul 07 17:00:10.381364 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.381304    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"]
Jul 07 17:00:10.386085 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.386056    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.398204 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.398171    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"]
Jul 07 17:00:10.445268 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.445228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-proc\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.445561 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.445541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-sys\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.445756 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.445739    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs9cv\" (UniqueName: \"kubernetes.io/projected/f0d850bb-6e56-4b62-952f-8e0afec7a45c-kube-api-access-rs9cv\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.445886 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.445872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-lib-modules\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.446004 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.445992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-podres\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.546807 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.546767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-proc\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.547027 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.546859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-sys\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.547027 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.546923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs9cv\" (UniqueName: \"kubernetes.io/projected/f0d850bb-6e56-4b62-952f-8e0afec7a45c-kube-api-access-rs9cv\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.547027 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.546951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-lib-modules\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.547027 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.546981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-podres\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.547248 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.547149    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-podres\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.547248 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.547207    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-proc\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.547346 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.547254    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-sys\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.547529 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.547498    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0d850bb-6e56-4b62-952f-8e0afec7a45c-lib-modules\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.559605 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.559571    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs9cv\" (UniqueName: \"kubernetes.io/projected/f0d850bb-6e56-4b62-952f-8e0afec7a45c-kube-api-access-rs9cv\") pod \"perf-node-gather-daemonset-zx8q4\" (UID: \"f0d850bb-6e56-4b62-952f-8e0afec7a45c\") " pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.698226 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.698131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:10.910022 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:10.909995    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"]
Jul 07 17:00:10.913241 ip-10-0-136-99 kubenswrapper[2563]: W0707 17:00:10.913210    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf0d850bb_6e56_4b62_952f_8e0afec7a45c.slice/crio-f705b21e0c6ffcebe57179afdbe2e7f2f65a28e9ab503d932adb1b2fd7c95b36 WatchSource:0}: Error finding container f705b21e0c6ffcebe57179afdbe2e7f2f65a28e9ab503d932adb1b2fd7c95b36: Status 404 returned error can't find the container with id f705b21e0c6ffcebe57179afdbe2e7f2f65a28e9ab503d932adb1b2fd7c95b36
Jul 07 17:00:11.013177 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:11.013139    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-t56mf_876c12c7-fafd-42ae-beb9-1bdd5b938820/networking-console-plugin/0.log"
Jul 07 17:00:11.716574 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:11.716539    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4" event={"ID":"f0d850bb-6e56-4b62-952f-8e0afec7a45c","Type":"ContainerStarted","Data":"6be362f34e536ac129520fb9a400dafa085b3784bb39b83afee03b0f45685bac"}
Jul 07 17:00:11.716990 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:11.716587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4" event={"ID":"f0d850bb-6e56-4b62-952f-8e0afec7a45c","Type":"ContainerStarted","Data":"f705b21e0c6ffcebe57179afdbe2e7f2f65a28e9ab503d932adb1b2fd7c95b36"}
Jul 07 17:00:11.716990 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:11.716667    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:11.735663 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:11.735605    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4" podStartSLOduration=1.735584485 podStartE2EDuration="1.735584485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:00:11.733292541 +0000 UTC m=+2505.087577790" watchObservedRunningTime="2026-07-07 17:00:11.735584485 +0000 UTC m=+2505.089869734"
Jul 07 17:00:13.795890 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:13.795863    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wft9m_52347fbd-246a-4419-9cd6-9393930aa41a/dns/0.log"
Jul 07 17:00:13.821211 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:13.821180    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wft9m_52347fbd-246a-4419-9cd6-9393930aa41a/kube-rbac-proxy/0.log"
Jul 07 17:00:13.908099 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:13.908071    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xqh4g_48e6664e-d120-47c3-bd5b-c51e68bc47cb/dns-node-resolver/0.log"
Jul 07 17:00:14.541377 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:14.541340    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l4g2p_ef779192-a1a5-446e-9eb3-472d5871d0fb/node-ca/0.log"
Jul 07 17:00:15.564621 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:15.564585    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46mzj2_f842bd1b-ec8f-4baf-b042-90917b33dea7/istio-proxy/0.log"
Jul 07 17:00:15.707780 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:15.707753    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbbdb79bb-7txjg_201979d1-95ba-41bc-9ec4-a93886cce720/kube-auth-proxy/0.log"
Jul 07 17:00:16.643867 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:16.643826    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fv955_0f195809-b971-4983-ac73-6002fc3a10a0/serve-healthcheck-canary/0.log"
Jul 07 17:00:17.213575 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:17.213547    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9vn2v_10f7d95b-d9e6-426e-b4fc-1ac7290f37d7/kube-rbac-proxy/0.log"
Jul 07 17:00:17.246040 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:17.246013    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9vn2v_10f7d95b-d9e6-426e-b4fc-1ac7290f37d7/exporter/0.log"
Jul 07 17:00:17.278377 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:17.278345    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9vn2v_10f7d95b-d9e6-426e-b4fc-1ac7290f37d7/extractor/0.log"
Jul 07 17:00:17.736152 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:17.736126    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-948xd/perf-node-gather-daemonset-zx8q4"
Jul 07 17:00:20.635038 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:20.635011    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tfcgw_9df4643c-39c8-42cc-8d3b-2501657cfc3e/server/0.log"
Jul 07 17:00:20.862101 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:20.862066    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f64778974-5nz45_70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0/manager/0.log"
Jul 07 17:00:20.889798 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:20.889709    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f64778974-5nz45_70e6f2ea-2d9a-46cc-8a04-a51f4d5df9e0/copy-manifests/0.log"
Jul 07 17:00:21.250792 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:21.250700    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46mzj2_f842bd1b-ec8f-4baf-b042-90917b33dea7/istio-proxy/0.log"
Jul 07 17:00:21.374095 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:21.374063    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbbdb79bb-7txjg_201979d1-95ba-41bc-9ec4-a93886cce720/kube-auth-proxy/0.log"
Jul 07 17:00:22.418773 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:22.418743    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5cb66b9dcc-zzw9n_d16934bb-942f-49a8-96a4-0bcabf033059/manager/0.log"
Jul 07 17:00:22.686305 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:22.686270    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf46mzj2_f842bd1b-ec8f-4baf-b042-90917b33dea7/istio-proxy/0.log"
Jul 07 17:00:22.810795 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:22.810761    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cbbdb79bb-7txjg_201979d1-95ba-41bc-9ec4-a93886cce720/kube-auth-proxy/0.log"
Jul 07 17:00:27.389746 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:27.389664    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-f46tw_5e8793fa-f3cd-4712-bb95-29907af85258/migrator/0.log"
Jul 07 17:00:27.412823 ip-10-0-136-99 kubenswrapper[2563]: I0707 17:00:27.412787    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-f46tw_5e8793fa-f3cd-4712-bb95-29907af85258/graceful-termination/0.log"