Jul 06 19:19:53.881371 ip-10-0-135-109 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 19:19:54.246075 ip-10-0-135-109 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:19:54.246075 ip-10-0-135-109 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 19:19:54.246075 ip-10-0-135-109 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:19:54.246075 ip-10-0-135-109 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 19:19:54.246075 ip-10-0-135-109 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 19:19:54.247023 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.246900    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 19:19:54.251332 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251315    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:19:54.251332 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251331    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251335    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251339    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251342    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251345    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251347    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251350    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251353    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251355    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251358    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251361    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251363    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251366    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251368    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251371    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251375    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251378    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251380    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251383    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251397    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:19:54.251406 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251400    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251402    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251405    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251408    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251411    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251414    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251416    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251419    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251422    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251424    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251427    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251429    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251432    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251435    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251437    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251440    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251442    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251445    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251447    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251450    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:19:54.251857 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251452    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251455    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251457    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251459    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251462    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251464    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251467    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251470    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251472    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251475    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251478    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251480    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251484    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251486    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251489    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251492    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251494    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251497    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251499    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251502    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:19:54.252348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251504    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251507    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251510    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251512    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251515    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251517    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251519    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251522    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251524    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251527    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251532    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251535    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251539    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251541    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251544    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251547    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251550    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251553    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251556    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:19:54.252862 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251558    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251561    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251563    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251566    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251568    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251571    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251574    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251576    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251581    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251584    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251588    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251591    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251593    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251596    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251600    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251603    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251607    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251610    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.251612    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:19:54.253323 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252323    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252329    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252332    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252335    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252338    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252340    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252343    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252346    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252348    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252351    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252354    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252357    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252360    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252363    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252366    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252368    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252372    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252376    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252380    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252383    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:19:54.253766 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252387    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252390    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252393    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252395    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252398    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252401    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252403    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252406    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252409    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252411    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252414    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252416    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252419    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252421    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252424    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252426    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252429    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252432    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252435    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:19:54.254258 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252438    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252441    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252443    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252445    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252449    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252452    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252455    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252457    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252460    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252462    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252465    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252468    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252470    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252474    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252477    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252479    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252482    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252484    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252487    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252489    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:19:54.254703 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252492    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252494    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252497    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252499    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252501    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252504    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252506    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252509    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252511    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252513    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252516    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252518    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252521    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252524    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252526    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252529    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252532    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252535    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252538    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252541    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:19:54.255222 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252543    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252546    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252549    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252552    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252554    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252557    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252559    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252562    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252565    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252567    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252569    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252572    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252574    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252577    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252579    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252583    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252586    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252589    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252592    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.252594    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:19:54.255696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253036    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253043    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253046    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253050    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253053    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253055    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253058    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253060    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253063    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253067    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253071    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253074    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253077    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253080    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253083    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253086    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253088    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253091    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253093    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253097    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:19:54.256206 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253099    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253102    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253105    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253107    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253110    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253112    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253115    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253117    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253120    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253122    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253125    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253127    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253130    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253132    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253135    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253137    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253140    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253142    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253144    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253147    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:19:54.257131 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253150    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253152    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253155    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253157    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253160    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253163    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253165    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253168    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253170    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253173    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253176    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253178    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253181    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253183    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253186    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253188    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253191    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253194    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253197    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253199    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:19:54.257778 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253202    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253204    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253206    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253209    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253211    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253214    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253217    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253220    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253222    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253225    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253227    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253230    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253233    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253236    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253238    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253241    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253243    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253246    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253249    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:19:54.258315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253252    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253255    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253257    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253260    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253262    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253265    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253268    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253270    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253273    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253275    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253278    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253281    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253285    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253288    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253290    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253296    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253298    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253303    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253306    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:19:54.258837 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.253310    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253380    2579 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253386    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253393    2579 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253399    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253403    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253407    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253411    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253415    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253418    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253421    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253425    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253428    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253431    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253434    2579 flags.go:64] FLAG: --cgroup-root=""
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253437    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253440    2579 flags.go:64] FLAG: --client-ca-file=""
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253443    2579 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253446    2579 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253449    2579 flags.go:64] FLAG: --cluster-domain=""
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253453    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253456    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253459    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253462    2579 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 19:19:54.259339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253467    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253470    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253473    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253477    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253482    2579 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253485    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253488    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253491    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253493    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253497    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253500    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253503    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253506    2579 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253509    2579 flags.go:64] FLAG: --enable-server="true"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253512    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253516    2579 flags.go:64] FLAG: --event-burst="100"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253519    2579 flags.go:64] FLAG: --event-qps="50"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253522    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253524    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253527    2579 flags.go:64] FLAG: --eviction-hard=""
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253531    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253534    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253537    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253540    2579 flags.go:64] FLAG: --eviction-soft=""
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253542    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 19:19:54.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253545    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253548    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253551    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253554    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253557    2579 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253560    2579 flags.go:64] FLAG: --feature-gates=""
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253564    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253567    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253570    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253573    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253576    2579 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253580    2579 flags.go:64] FLAG: --help="false"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253583    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-135-109.ec2.internal"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253586    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253589    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253592    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253596    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253599    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253602    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253605    2579 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253608    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253611    2579 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253615    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253618    2579 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 19:19:54.260513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253621    2579 flags.go:64] FLAG: --kube-reserved=""
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253624    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253627    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253630    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253633    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253636    2579 flags.go:64] FLAG: --lock-file=""
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253639    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253641    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253644    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253650    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253653    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253655    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253659    2579 flags.go:64] FLAG: --logging-format="text"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253662    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253666    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253669    2579 flags.go:64] FLAG: --manifest-url=""
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253672    2579 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253676    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253679    2579 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253684    2579 flags.go:64] FLAG: --max-pods="110"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253687    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253690    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253693    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253696    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253699    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 19:19:54.261121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253702    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253705    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253712    2579 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253720    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253723    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253726    2579 flags.go:64] FLAG: --pod-cidr=""
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253729    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253735    2579 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253738    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253741    2579 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253744    2579 flags.go:64] FLAG: --port="10250"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253747    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253750    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08487e975ad3bd6bf"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253753    2579 flags.go:64] FLAG: --qos-reserved=""
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253756    2579 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253759    2579 flags.go:64] FLAG: --register-node="true"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253762    2579 flags.go:64] FLAG: --register-with-taints=""
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253766    2579 flags.go:64] FLAG: --registry-burst="10"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253768    2579 flags.go:64] FLAG: --registry-qps="5"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253772    2579 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253776    2579 flags.go:64] FLAG: --reserved-memory=""
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253780    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253783    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253786    2579 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253789    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 19:19:54.261789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253792    2579 flags.go:64] FLAG: --runonce="false"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253795    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253798    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253801    2579 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253804    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253807    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253809    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253812    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253815    2579 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253818    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253820    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253823    2579 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253826    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253829    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253832    2579 flags.go:64] FLAG: --system-cgroups=""
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253834    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253839    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253842    2579 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253847    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253850    2579 flags.go:64] FLAG: --tls-min-version=""
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253853    2579 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253856    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253859    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253862    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253865    2579 flags.go:64] FLAG: --v="2"
Jul 06 19:19:55.889254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253868    2579 flags.go:64] FLAG: --version="false"
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253873    2579 flags.go:64] FLAG: --vmodule=""
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253877    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.253880    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254054    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254068    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254071    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254074    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254077    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254080    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254083    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254085    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254088    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254091    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254093    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254096    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254098    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254101    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254104    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254106    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:19:55.890167 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254109    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254111    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254115    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254117    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254120    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254123    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254126    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254128    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254131    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254133    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254136    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254139    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254142    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254145    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254147    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254150    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254152    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254156    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254158    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254161    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:19:55.890696 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254164    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254167    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254169    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254172    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254174    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254177    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254180    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254182    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254185    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254187    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254190    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254192    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254195    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254197    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254201    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254203    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254206    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254208    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254211    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:19:55.891270 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254213    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254216    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254219    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254222    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254224    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254227    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254229    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254232    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254235    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254237    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254242    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254246    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254250    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254255    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254258    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254261    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254264    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254268    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254270    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:19:55.891752 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254273    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254276    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254278    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254282    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254284    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254287    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254290    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254292    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254295    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254297    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254301    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254305    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254308    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254311    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254313    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254316    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254319    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254321    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254324    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254326    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:19:55.892211 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254329    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254332    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254335    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254338    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:54.254341    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:54.254981    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.890380    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.890397    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.890417    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.890423    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890478    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890483    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890486    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890491    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890495    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:19:55.892687 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890499    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890501    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890504    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890507    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890509    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890512    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890515    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890517    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890520    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890523    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890526    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890529    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890532    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890534    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890537    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890539    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890542    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890545    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890547    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890550    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:19:55.893075 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890553    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890555    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890558    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890561    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890564    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890567    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890569    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890572    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890574    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890577    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890580    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890582    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890585    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890587    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890590    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890592    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890595    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890597    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890600    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890602    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:19:55.893559 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890605    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890608    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890610    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890613    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890615    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890618    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890620    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890623    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890625    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890628    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890630    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890633    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890635    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890638    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890641    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890643    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890646    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890649    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890652    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890654    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:19:55.894087 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890658    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890661    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890663    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890666    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890668    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890671    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890674    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890676    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890679    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890681    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890684    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890686    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890689    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890691    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890694    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890698    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890722    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890726    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890729    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:19:55.894571 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890732    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890735    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890738    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890741    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890744    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890746    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890749    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890752    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890755    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890759    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890763    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890766    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890768    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890771    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:19:55.895125 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890774    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.890779    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890897    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890903    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890906    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890910    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890913    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890915    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890918    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890921    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890923    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890928    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890931    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890934    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 19:19:55.895452 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890937    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890940    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890943    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890945    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890948    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890950    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890953    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890955    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890958    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890961    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890963    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890966    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890969    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890972    2579 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890974    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890977    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890979    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890982    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890985    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890987    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 19:19:55.895833 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890989    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890992    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890995    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.890997    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891000    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891002    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891005    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891008    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891010    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891013    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891015    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891018    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891020    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891023    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891026    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891029    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891031    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891034    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891036    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891039    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 19:19:55.896315 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891041    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891044    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891047    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891050    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891053    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891055    2579 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891058    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891060    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891063    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891065    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891068    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891070    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891073    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891075    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891078    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891081    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891083    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891086    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891089    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891091    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 19:19:55.896813 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891094    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891096    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891099    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891101    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891104    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891106    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891109    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891112    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891114    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891118    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891121    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891124    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891127    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891129    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891132    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891135    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891137    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891140    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891142    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 19:19:55.897296 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891146    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891150    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891152    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891155    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891158    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891161    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891164    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:55.891166    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.891172    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.891286    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.893385    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.894737    2579 server.go:1019] "Starting client certificate rotation"
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.894844    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:19:55.897805 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.895505    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 19:19:55.898115 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.897039    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:19:55.898190 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.898171    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 19:19:55.908560 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.908538    2579 log.go:25] "Validated CRI v1 runtime API"
Jul 06 19:19:55.910632 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.910615    2579 log.go:25] "Validated CRI v1 image API"
Jul 06 19:19:55.911359 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.911344    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 19:19:55.914006 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.913987    2579 fs.go:135] Filesystem UUIDs: map[0b1c6d26-8e22-4919-a3c0-6d673176feb3:/dev/nvme0n1p4 0b720616-81bf-4cf2-93a3-61ca45738a68:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 06 19:19:55.914071 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.914006    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 19:19:55.920456 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.920083    2579 manager.go:216] Machine: {Timestamp:2026-07-06 19:19:55.918566279 +0000 UTC m=+0.291048006 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106000 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cb7ffeefdefedbdb8215f5a56e475 SystemUUID:ec2cb7ff-eefd-efed-bdb8-215f5a56e475 BootID:5a2fe7f9-12c0-4327-ba61-82238d383849 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f4:25:8d:90:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f4:25:8d:90:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:01:20:39:c1:b5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 19:19:55.920456 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.920447    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 19:19:55.920627 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.920547    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 19:19:55.923267 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.923242    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 19:19:55.923402 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.923267    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 19:19:55.923953 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.923943    2579 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 19:19:55.923988 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.923956    2579 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 19:19:55.923988 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.923963    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:19:55.923988 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.923977    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 19:19:55.925465 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.925455    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 19:19:55.929495 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.929480    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:19:55.929610 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.929600    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 19:19:55.930232 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.930223    2579 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 19:19:55.930279 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.930234    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 19:19:55.930279 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.930251    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 19:19:55.930279 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.930261    2579 kubelet.go:398] "Adding apiserver pod source"
Jul 06 19:19:55.930279 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.930268    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 19:19:55.930590 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.930580    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:19:55.930619 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.930597    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 19:19:55.932575 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.932557    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 19:19:55.934471 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.934448    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:19:55.934602 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.934588    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 19:19:55.934652 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.934627    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 19:19:55.935796 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935786    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 19:19:55.935831 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935802    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 19:19:55.935831 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935809    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 19:19:55.935831 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935814    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 19:19:55.935831 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935824    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 19:19:55.935937 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935832    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 19:19:55.935937 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935843    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 19:19:55.935937 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935849    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 19:19:55.935937 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935857    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 19:19:55.935937 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935863    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 19:19:55.935937 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935876    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 19:19:55.935937 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.935882    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 19:19:55.936561 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.936552    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 19:19:55.936561 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.936561    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 19:19:55.939851 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.939832    2579 server.go:1268] "Started kubelet"
Jul 06 19:19:55.940021 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.939985    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 19:19:55.940664 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.940602    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 19:19:55.940768 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.940690    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 19:19:55.940734 ip-10-0-135-109 systemd[1]: Started Kubernetes Kubelet.
Jul 06 19:19:55.942027 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:55.942004    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 19:19:55.942027 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.942018    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 19:19:55.942027 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:55.942030    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 19:19:55.942205 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.942057    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 19:19:55.942476 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.942461    2579 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 19:19:55.944902 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:55.944039    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-109.ec2.internal.18bfc98f92a4f00c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-109.ec2.internal,UID:ip-10-0-135-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-109.ec2.internal,},FirstTimestamp:2026-07-06 19:19:55.939794956 +0000 UTC m=+0.312276685,LastTimestamp:2026-07-06 19:19:55.939794956 +0000 UTC m=+0.312276685,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-109.ec2.internal,}"
Jul 06 19:19:55.945489 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:55.945473    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 19:19:55.948639 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.948598    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 19:19:55.948639 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.948611    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 19:19:55.948791 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:55.948756    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:55.949230 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.949213    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 19:19:55.949356 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.949320    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 19:19:55.949356 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.949333    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 19:19:55.949625 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.949602    2579 factory.go:153] Registering CRI-O factory
Jul 06 19:19:55.949625 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.949617    2579 factory.go:223] Registration of the crio container factory successfully
Jul 06 19:19:55.949761 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.949670    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 19:19:55.949761 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.949677    2579 factory.go:55] Registering systemd factory
Jul 06 19:19:55.949761 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.949682    2579 factory.go:223] Registration of the systemd container factory successfully
Jul 06 19:19:55.949761 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.949697    2579 factory.go:103] Registering Raw factory
Jul 06 19:19:55.949761 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.949724    2579 manager.go:1196] Started watching for new ooms in manager
Jul 06 19:19:55.950185 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.950139    2579 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 19:19:55.950185 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.950152    2579 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 19:19:55.950338 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.950272    2579 manager.go:349] Starting recovery of all containers
Jul 06 19:19:55.950530 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:55.950501    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 19:19:55.950855 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:55.950834    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 19:19:55.964206 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.964071    2579 manager.go:354] Recovery completed
Jul 06 19:19:55.968404 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.968392    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:19:55.969594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.969572    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2w6v8"
Jul 06 19:19:55.970185 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.970169    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:19:55.970232 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.970199    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:19:55.970232 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.970214    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:19:55.970777 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.970760    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 19:19:55.970777 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.970774    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:19:55.970876 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.970776    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 19:19:55.970876 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.970846    2579 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 19:19:55.971476 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.971462    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:19:55.971550 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.971492    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:19:55.971550 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.971507    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:19:55.973068 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.973056    2579 policy_none.go:49] "None policy: Start"
Jul 06 19:19:55.973068 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.973071    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 19:19:55.973170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.973081    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 19:19:55.975093 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.975080    2579 policy_none.go:47] "Start"
Jul 06 19:19:55.977254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:55.977238    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2w6v8"
Jul 06 19:19:55.980021 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:55.979938    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-109.ec2.internal.18bfc98f9474a4d2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-109.ec2.internal,UID:ip-10-0-135-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-109.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-109.ec2.internal,},FirstTimestamp:2026-07-06 19:19:55.970184402 +0000 UTC m=+0.342666124,LastTimestamp:2026-07-06 19:19:55.970184402 +0000 UTC m=+0.342666124,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-109.ec2.internal,}"
Jul 06 19:19:56.005225 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.005210    2579 manager.go:337] "Starting Device Plugin manager"
Jul 06 19:19:56.005307 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.005244    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 19:19:56.005307 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.005253    2579 server.go:87] "Starting device plugin registration server"
Jul 06 19:19:56.005493 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.005469    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 19:19:56.005571 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.005486    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 19:19:56.005651 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.005639    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 19:19:56.005758 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.005735    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 19:19:56.005758 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.005744    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 19:19:56.006146 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.006121    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 19:19:56.006224 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.006171    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.091622 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.091574    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 19:19:56.093927 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.092772    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 19:19:56.093927 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.092815    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 19:19:56.093927 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.092838    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 19:19:56.093927 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.092873    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 19:19:56.095882 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.095863    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:19:56.106028 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.106013    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:19:56.107093 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.107074    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:19:56.107165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.107116    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:19:56.107165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.107128    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:19:56.107165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.107151    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.116066 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.116052    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.116116 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.116074    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-109.ec2.internal\": node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.128990 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.128965    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.193771 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.193737    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal"]
Jul 06 19:19:56.193925 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.193839    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:19:56.195356 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.195338    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:19:56.195447 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.195368    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:19:56.195447 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.195377    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:19:56.197731 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.197698    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:19:56.197853 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.197826    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.197910 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.197874    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:19:56.198436 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.198417    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:19:56.198491 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.198451    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:19:56.198491 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.198461    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:19:56.198565 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.198424    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:19:56.198565 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.198523    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:19:56.198565 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.198537    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:19:56.200981 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.200936    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.200981 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.200967    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:19:56.201624 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.201605    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:19:56.201688 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.201634    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:19:56.201688 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.201648    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:19:56.224380 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.224358    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-109.ec2.internal\" not found" node="ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.228796 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.228775    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-109.ec2.internal\" not found" node="ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.229720 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.229693    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.251820 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.251796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/982b49a93d1da23776ac74c818955a1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal\" (UID: \"982b49a93d1da23776ac74c818955a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.251925 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.251828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/982b49a93d1da23776ac74c818955a1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal\" (UID: \"982b49a93d1da23776ac74c818955a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.251925 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.251855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc08615788179b892d68aba0ae981b36-config\") pod \"kube-apiserver-proxy-ip-10-0-135-109.ec2.internal\" (UID: \"fc08615788179b892d68aba0ae981b36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.330191 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.330168    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.352817 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.352796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/982b49a93d1da23776ac74c818955a1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal\" (UID: \"982b49a93d1da23776ac74c818955a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.352883 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.352825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc08615788179b892d68aba0ae981b36-config\") pod \"kube-apiserver-proxy-ip-10-0-135-109.ec2.internal\" (UID: \"fc08615788179b892d68aba0ae981b36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.352883 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.352842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/982b49a93d1da23776ac74c818955a1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal\" (UID: \"982b49a93d1da23776ac74c818955a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.352883 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.352872    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/982b49a93d1da23776ac74c818955a1f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal\" (UID: \"982b49a93d1da23776ac74c818955a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.352986 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.352892    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/982b49a93d1da23776ac74c818955a1f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal\" (UID: \"982b49a93d1da23776ac74c818955a1f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.352986 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.352903    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fc08615788179b892d68aba0ae981b36-config\") pod \"kube-apiserver-proxy-ip-10-0-135-109.ec2.internal\" (UID: \"fc08615788179b892d68aba0ae981b36\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.431129 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.431089    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.527611 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.527535    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.531179 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.531162    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.532827 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.532567    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:56.631916 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.631880    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.732463 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.732434    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.832966 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.832902    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.894491 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.894458    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 19:19:56.894990 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.894610    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 19:19:56.933929 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:56.933902    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:56.979790 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.979751    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:14:55 +0000 UTC" deadline="2027-12-23 14:45:56.707656412 +0000 UTC"
Jul 06 19:19:56.979790 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:56.979785    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12835h25m59.72787428s"
Jul 06 19:19:57.034006 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:57.033976    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:57.048159 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.048137    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 19:19:57.049334 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.049312    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 19:19:57.049419 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.049352    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 19:19:57.049419 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.049363    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeHasSufficientPID"
Jul 06 19:19:57.086455 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:57.086400    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc08615788179b892d68aba0ae981b36.slice/crio-242f428db322e36f6d35aeef793312fa65f4260d045c70198750514660892d1f WatchSource:0}: Error finding container 242f428db322e36f6d35aeef793312fa65f4260d045c70198750514660892d1f: Status 404 returned error can't find the container with id 242f428db322e36f6d35aeef793312fa65f4260d045c70198750514660892d1f
Jul 06 19:19:57.086799 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:57.086779    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982b49a93d1da23776ac74c818955a1f.slice/crio-33351cc9a3bbc5bb6f0c921dc1e72bc29287ee7fe7c7dfcfe3b5630ff32db3c2 WatchSource:0}: Error finding container 33351cc9a3bbc5bb6f0c921dc1e72bc29287ee7fe7c7dfcfe3b5630ff32db3c2: Status 404 returned error can't find the container with id 33351cc9a3bbc5bb6f0c921dc1e72bc29287ee7fe7c7dfcfe3b5630ff32db3c2
Jul 06 19:19:57.091450 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.091430    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:19:57.096008 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.095972    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal" event={"ID":"fc08615788179b892d68aba0ae981b36","Type":"ContainerStarted","Data":"242f428db322e36f6d35aeef793312fa65f4260d045c70198750514660892d1f"}
Jul 06 19:19:57.096982 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.096964    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal" event={"ID":"982b49a93d1da23776ac74c818955a1f","Type":"ContainerStarted","Data":"33351cc9a3bbc5bb6f0c921dc1e72bc29287ee7fe7c7dfcfe3b5630ff32db3c2"}
Jul 06 19:19:57.134440 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:57.134397    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:57.187465 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.187440    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:19:57.235466 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:57.235420    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:57.336018 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:57.335986    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-109.ec2.internal\" not found"
Jul 06 19:19:57.404318 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.404236    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:19:57.415945 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.415924    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:19:57.449267 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.449236    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:57.461054 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.461035    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:19:57.461935 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.461921    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal"
Jul 06 19:19:57.470900 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.470884    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 19:19:57.931905 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.931859    2579 apiserver.go:52] "Watching apiserver"
Jul 06 19:19:57.940428 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.940368    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 19:19:57.940858 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.940827    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal","openshift-multus/multus-vqfqz","openshift-multus/network-metrics-daemon-zmz58","openshift-ovn-kubernetes/ovnkube-node-jm6bj","kube-system/global-pull-secret-syncer-sl8dp","kube-system/konnectivity-agent-dr57n","kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw","openshift-dns/node-resolver-kxxj8","openshift-multus/multus-additional-cni-plugins-trmsh","openshift-network-diagnostics/network-check-target-pxm72","openshift-network-operator/iptables-alerter-dptw6","openshift-cluster-node-tuning-operator/tuned-g75kf","openshift-image-registry/node-ca-wbtx4"]
Jul 06 19:19:57.943446 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.943422    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:57.946239 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.945817    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.946239 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.945983    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 19:19:57.946239 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.946183    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 19:19:57.946239 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.946218    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 19:19:57.946483 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.946361    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 19:19:57.946632 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.946613    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gbqtl\""
Jul 06 19:19:57.946738 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.946629    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 19:19:57.948052 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.947989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:19:57.948142 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:57.948065    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:19:57.949208 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.948626    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:19:57.949208 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.948899    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 19:19:57.949208 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.948981    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wbqhz\""
Jul 06 19:19:57.949208 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.949072    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 19:19:57.950388 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.950350    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.952697 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.952677    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 19:19:57.952802 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.952715    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:57.952802 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.952679    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 19:19:57.952802 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:57.952774    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:19:57.954638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.954619    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 19:19:57.954892 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.954874    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 19:19:57.955016 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.954995    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 19:19:57.955080 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.955043    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 19:19:57.955523 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.955495    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n6tvk\""
Jul 06 19:19:57.956555 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.956534    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:19:57.958991 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.958970    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:57.959088 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.959012    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5ccmb\""
Jul 06 19:19:57.959430 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.959405    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 19:19:57.959506 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.959452    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 19:19:57.961467 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.961422    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:57.962226 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962094    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xbppp\""
Jul 06 19:19:57.962226 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962132    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 19:19:57.962226 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962137    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 19:19:57.962641 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.962756 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-cni-netd\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.962829 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.962829 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962817    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:57.962933 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962878    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7hnp\" (UniqueName: \"kubernetes.io/projected/c612c049-b29b-41d4-a65f-36c081c210ec-kube-api-access-l7hnp\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:57.962933 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-sys\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.963032 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962974    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:19:57.963089 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.962999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-run-netns\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963089 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-run-openvswitch\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963187 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x99h2\" (UniqueName: \"kubernetes.io/projected/5b2e3337-5dc8-452a-938f-193dc82597d9-kube-api-access-x99h2\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963187 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-system-cni-dir\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:57.963187 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c612c049-b29b-41d4-a65f-36c081c210ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:57.963329 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-kubernetes\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.963329 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-sysctl-conf\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.963329 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-lib-modules\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.963463 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-var-lib-openvswitch\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963463 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-node-log\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963463 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-cnibin\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:57.963463 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-sysconfig\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.963463 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963448    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-tuned\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.963733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-run-systemd\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963496    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b2e3337-5dc8-452a-938f-193dc82597d9-ovnkube-config\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963517    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b2e3337-5dc8-452a-938f-193dc82597d9-env-overrides\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-systemd\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.963733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5fvv\" (UniqueName: \"kubernetes.io/projected/d6a569af-557b-4a76-89bf-65b1b988ceec-kube-api-access-l5fvv\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.963733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963581    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-systemd-units\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-etc-openvswitch\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-cni-bin\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.963733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963657    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-os-release\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:57.963733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963680    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stsqx\" (UniqueName: \"kubernetes.io/projected/0a0cc905-4958-4e00-afc0-8687189c0780-kube-api-access-stsqx\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-log-socket\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b2e3337-5dc8-452a-938f-193dc82597d9-ovnkube-script-lib\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963783    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c612c049-b29b-41d4-a65f-36c081c210ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963822    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c612c049-b29b-41d4-a65f-36c081c210ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963856    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-var-lib-kubelet\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6a569af-557b-4a76-89bf-65b1b988ceec-tmp\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-run-ovn\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963965    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.963980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-sysctl-d\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.964002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-run\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.964023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-host\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.964044    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.964062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-kubelet\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.964093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-slash\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.964118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b2e3337-5dc8-452a-938f-193dc82597d9-ovn-node-metrics-cert\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:57.964240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.964142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-modprobe-d\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:57.964900 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.964851    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 19:19:57.965098 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.965076    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vstc2\""
Jul 06 19:19:57.965431 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.965272    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 19:19:57.965431 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.965298    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 19:19:57.967192 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.966053    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:57.967192 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.967041    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 19:19:57.967192 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.967079    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mr77v\""
Jul 06 19:19:57.968650 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.968591    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:19:57.968758 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:57.968657    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:19:57.969467 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.969447    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 19:19:57.969549 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.969484    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 19:19:57.969652 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.969633    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 19:19:57.969828 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.969811    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gfbt5\""
Jul 06 19:19:57.970930 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.970911    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:57.974870 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.974841    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 19:19:57.975189 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.975172    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hsvq2\""
Jul 06 19:19:57.975277 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.975220    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 19:19:57.975338 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.975195    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 19:19:57.998361 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:57.998335    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9vw6"
Jul 06 19:19:58.006958 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.006939    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9vw6"
Jul 06 19:19:58.050361 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.050336    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 19:19:58.064429 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-var-lib-kubelet\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.064429 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064424    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-run-multus-certs\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.064612 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-var-lib-openvswitch\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.064612 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064463    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-conf-dir\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.064612 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b2e3337-5dc8-452a-938f-193dc82597d9-ovnkube-config\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.064612 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b2e3337-5dc8-452a-938f-193dc82597d9-env-overrides\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.064612 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064599    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-var-lib-openvswitch\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.064872 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-systemd\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.064872 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d229434-d957-4156-866f-b92159f30e6c-host-slash\") pod \"iptables-alerter-dptw6\" (UID: \"2d229434-d957-4156-866f-b92159f30e6c\") " pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:58.064872 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064657    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-systemd\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.064872 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064678    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:58.064872 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064722    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-var-lib-cni-bin\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.065138 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.064918    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-systemd-units\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.065138 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065103    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b2e3337-5dc8-452a-938f-193dc82597d9-env-overrides\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.065215 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-systemd-units\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.065254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-os-release\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.065254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-socket-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.065254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de9436a0-5a95-46b4-bbbe-91f60647201f-agent-certs\") pod \"konnectivity-agent-dr57n\" (UID: \"de9436a0-5a95-46b4-bbbe-91f60647201f\") " pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:19:58.065391 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-run-netns\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.065391 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065274    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6a569af-557b-4a76-89bf-65b1b988ceec-tmp\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.065391 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.065391 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fddbd\" (UniqueName: \"kubernetes.io/projected/6811610c-2544-44eb-ac5b-8067dbacf3bb-kube-api-access-fddbd\") pod \"node-ca-wbtx4\" (UID: \"6811610c-2544-44eb-ac5b-8067dbacf3bb\") " pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:58.065391 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065356    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23a01417-97d0-4c52-867c-dd9e9567ca4b-dbus\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:58.065391 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12a849a-9067-4be2-903b-f4e80b6c4bee-tmp-dir\") pod \"node-resolver-kxxj8\" (UID: \"f12a849a-9067-4be2-903b-f4e80b6c4bee\") " pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065426    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-run-k8s-cni-cncf-io\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-run-ovn\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-sysctl-d\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065444    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-os-release\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065544    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-run-ovn\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065548    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b2e3337-5dc8-452a-938f-193dc82597d9-ovnkube-config\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-registration-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065569    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065600    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-sysctl-d\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065606    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-device-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.065638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065637    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de9436a0-5a95-46b4-bbbe-91f60647201f-konnectivity-ca\") pod \"konnectivity-agent-dr57n\" (UID: \"de9436a0-5a95-46b4-bbbe-91f60647201f\") " pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065667    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-daemon-config\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdc2b\" (UniqueName: \"kubernetes.io/projected/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-kube-api-access-hdc2b\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065754    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b2e3337-5dc8-452a-938f-193dc82597d9-ovn-node-metrics-cert\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-modprobe-d\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d229434-d957-4156-866f-b92159f30e6c-iptables-alerter-script\") pod \"iptables-alerter-dptw6\" (UID: \"2d229434-d957-4156-866f-b92159f30e6c\") " pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065870    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23a01417-97d0-4c52-867c-dd9e9567ca4b-kubelet-config\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-cni-netd\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065927    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-modprobe-d\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7hnp\" (UniqueName: \"kubernetes.io/projected/c612c049-b29b-41d4-a65f-36c081c210ec-kube-api-access-l7hnp\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.065996    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-cni-netd\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-sys\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.066073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066081    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f12a849a-9067-4be2-903b-f4e80b6c4bee-hosts-file\") pod \"node-resolver-kxxj8\" (UID: \"f12a849a-9067-4be2-903b-f4e80b6c4bee\") " pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-tuned\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066122    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066130    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-run-netns\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066152    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-run-openvswitch\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066157    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-lib-modules\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hv8b\" (UniqueName: \"kubernetes.io/projected/2d229434-d957-4156-866f-b92159f30e6c-kube-api-access-2hv8b\") pod \"iptables-alerter-dptw6\" (UID: \"2d229434-d957-4156-866f-b92159f30e6c\") " pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-hostroot\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066233    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-node-log\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066258    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-cnibin\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-sysconfig\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066306    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6811610c-2544-44eb-ac5b-8067dbacf3bb-serviceca\") pod \"node-ca-wbtx4\" (UID: \"6811610c-2544-44eb-ac5b-8067dbacf3bb\") " pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066331    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-system-cni-dir\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-run-systemd\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066383    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5fvv\" (UniqueName: \"kubernetes.io/projected/d6a569af-557b-4a76-89bf-65b1b988ceec-kube-api-access-l5fvv\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.066733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066417    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-sys\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.067563 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.066406    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nvsm\" (UniqueName: \"kubernetes.io/projected/e6eaa37c-12a6-45bd-8507-a6784169b040-kube-api-access-6nvsm\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.067563 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.067289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-etc-openvswitch\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.067563 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.067331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-cni-bin\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.067741 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.067578    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-etc-openvswitch\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.067801 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.067736    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-cni-bin\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.067874 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.067855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stsqx\" (UniqueName: \"kubernetes.io/projected/0a0cc905-4958-4e00-afc0-8687189c0780-kube-api-access-stsqx\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:19:58.067987 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.067966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-log-socket\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.068100 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.067997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b2e3337-5dc8-452a-938f-193dc82597d9-ovnkube-script-lib\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.068100 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068000    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-run-netns\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.068100 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c612c049-b29b-41d4-a65f-36c081c210ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.068100 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068066    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-run-openvswitch\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.068100 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c612c049-b29b-41d4-a65f-36c081c210ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.068364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068133    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-var-lib-kubelet\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.068364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-cnibin\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.068364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-run\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.068364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068232    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-host\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.068364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-var-lib-cni-multus\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.068364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068318    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-etc-kubernetes\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.068364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-kubelet\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.068644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-slash\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.068644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6811610c-2544-44eb-ac5b-8067dbacf3bb-host\") pod \"node-ca-wbtx4\" (UID: \"6811610c-2544-44eb-ac5b-8067dbacf3bb\") " pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:58.068644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-cni-dir\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.068644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.068644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:19:58.068644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lgb9\" (UniqueName: \"kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9\") pod \"network-check-target-pxm72\" (UID: \"5442c437-24f4-4cd3-9744-b687dc01e17c\") " pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:19:58.068644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjw4g\" (UniqueName: \"kubernetes.io/projected/f12a849a-9067-4be2-903b-f4e80b6c4bee-kube-api-access-qjw4g\") pod \"node-resolver-kxxj8\" (UID: \"f12a849a-9067-4be2-903b-f4e80b6c4bee\") " pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:58.068979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-os-release\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.068979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-cni-binary-copy\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.068979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-socket-dir-parent\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.068979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068829    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b2e3337-5dc8-452a-938f-193dc82597d9-ovnkube-script-lib\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.068979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-sys-fs\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.068979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x99h2\" (UniqueName: \"kubernetes.io/projected/5b2e3337-5dc8-452a-938f-193dc82597d9-kube-api-access-x99h2\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.068979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068895    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-log-socket\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.068979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068959    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-node-log\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-system-cni-dir\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.068999    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-cnibin\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069037    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c612c049-b29b-41d4-a65f-36c081c210ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-kubernetes\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-sysctl-conf\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069227    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6a569af-557b-4a76-89bf-65b1b988ceec-tmp\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069272    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-sysctl-conf\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069355    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b2e3337-5dc8-452a-938f-193dc82597d9-ovn-node-metrics-cert\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069446    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c612c049-b29b-41d4-a65f-36c081c210ec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069484    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-var-lib-kubelet\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069492    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-run-systemd\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069549    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c612c049-b29b-41d4-a65f-36c081c210ec-system-cni-dir\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069598    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.069681    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.069767    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs podName:0a0cc905-4958-4e00-afc0-8687189c0780 nodeName:}" failed. No retries permitted until 2026-07-06 19:19:58.569738918 +0000 UTC m=+2.942220627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs") pod "network-metrics-daemon-zmz58" (UID: "0a0cc905-4958-4e00-afc0-8687189c0780") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069764    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c612c049-b29b-41d4-a65f-36c081c210ec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.072276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069789    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-host\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.073131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.069872    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c612c049-b29b-41d4-a65f-36c081c210ec-cni-binary-copy\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.073131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.070173    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-sysconfig\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.073131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.070216    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-kubelet\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.073131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.070242    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-kubernetes\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.073131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.070380    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-run\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.073131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.070464    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b2e3337-5dc8-452a-938f-193dc82597d9-host-slash\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.073131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.070474    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6a569af-557b-4a76-89bf-65b1b988ceec-lib-modules\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.073131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.070800    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6a569af-557b-4a76-89bf-65b1b988ceec-etc-tuned\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.077212 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.077190    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7hnp\" (UniqueName: \"kubernetes.io/projected/c612c049-b29b-41d4-a65f-36c081c210ec-kube-api-access-l7hnp\") pod \"multus-additional-cni-plugins-trmsh\" (UID: \"c612c049-b29b-41d4-a65f-36c081c210ec\") " pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.078874 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.078853    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stsqx\" (UniqueName: \"kubernetes.io/projected/0a0cc905-4958-4e00-afc0-8687189c0780-kube-api-access-stsqx\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:19:58.080371 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.080328    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x99h2\" (UniqueName: \"kubernetes.io/projected/5b2e3337-5dc8-452a-938f-193dc82597d9-kube-api-access-x99h2\") pod \"ovnkube-node-jm6bj\" (UID: \"5b2e3337-5dc8-452a-938f-193dc82597d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.080371 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.080331    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5fvv\" (UniqueName: \"kubernetes.io/projected/d6a569af-557b-4a76-89bf-65b1b988ceec-kube-api-access-l5fvv\") pod \"tuned-g75kf\" (UID: \"d6a569af-557b-4a76-89bf-65b1b988ceec\") " pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.169418 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169386    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-conf-dir\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.169418 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d229434-d957-4156-866f-b92159f30e6c-host-slash\") pod \"iptables-alerter-dptw6\" (UID: \"2d229434-d957-4156-866f-b92159f30e6c\") " pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:58.169665 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169455    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:58.169665 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-var-lib-cni-bin\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.169665 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169498    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-conf-dir\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.169665 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169511    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d229434-d957-4156-866f-b92159f30e6c-host-slash\") pod \"iptables-alerter-dptw6\" (UID: \"2d229434-d957-4156-866f-b92159f30e6c\") " pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:58.169665 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-socket-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.169665 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.169558    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:19:58.169665 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169565    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-var-lib-cni-bin\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.169665 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de9436a0-5a95-46b4-bbbe-91f60647201f-agent-certs\") pod \"konnectivity-agent-dr57n\" (UID: \"de9436a0-5a95-46b4-bbbe-91f60647201f\") " pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:19:58.169665 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169639    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-socket-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.169665 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.169662    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret podName:23a01417-97d0-4c52-867c-dd9e9567ca4b nodeName:}" failed. No retries permitted until 2026-07-06 19:19:58.669642527 +0000 UTC m=+3.042124251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret") pod "global-pull-secret-syncer-sl8dp" (UID: "23a01417-97d0-4c52-867c-dd9e9567ca4b") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-run-netns\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169738    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fddbd\" (UniqueName: \"kubernetes.io/projected/6811610c-2544-44eb-ac5b-8067dbacf3bb-kube-api-access-fddbd\") pod \"node-ca-wbtx4\" (UID: \"6811610c-2544-44eb-ac5b-8067dbacf3bb\") " pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23a01417-97d0-4c52-867c-dd9e9567ca4b-dbus\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169833    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-run-netns\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169847    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12a849a-9067-4be2-903b-f4e80b6c4bee-tmp-dir\") pod \"node-resolver-kxxj8\" (UID: \"f12a849a-9067-4be2-903b-f4e80b6c4bee\") " pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-run-k8s-cni-cncf-io\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-registration-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-device-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169974    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de9436a0-5a95-46b4-bbbe-91f60647201f-konnectivity-ca\") pod \"konnectivity-agent-dr57n\" (UID: \"de9436a0-5a95-46b4-bbbe-91f60647201f\") " pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169980    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/23a01417-97d0-4c52-867c-dd9e9567ca4b-dbus\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.169995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-daemon-config\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdc2b\" (UniqueName: \"kubernetes.io/projected/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-kube-api-access-hdc2b\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170034    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-registration-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170045    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-device-dir\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.170203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d229434-d957-4156-866f-b92159f30e6c-iptables-alerter-script\") pod \"iptables-alerter-dptw6\" (UID: \"2d229434-d957-4156-866f-b92159f30e6c\") " pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23a01417-97d0-4c52-867c-dd9e9567ca4b-kubelet-config\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170131    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f12a849a-9067-4be2-903b-f4e80b6c4bee-hosts-file\") pod \"node-resolver-kxxj8\" (UID: \"f12a849a-9067-4be2-903b-f4e80b6c4bee\") " pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hv8b\" (UniqueName: \"kubernetes.io/projected/2d229434-d957-4156-866f-b92159f30e6c-kube-api-access-2hv8b\") pod \"iptables-alerter-dptw6\" (UID: \"2d229434-d957-4156-866f-b92159f30e6c\") " pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170164    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-run-k8s-cni-cncf-io\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-hostroot\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170184    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f12a849a-9067-4be2-903b-f4e80b6c4bee-tmp-dir\") pod \"node-resolver-kxxj8\" (UID: \"f12a849a-9067-4be2-903b-f4e80b6c4bee\") " pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6811610c-2544-44eb-ac5b-8067dbacf3bb-serviceca\") pod \"node-ca-wbtx4\" (UID: \"6811610c-2544-44eb-ac5b-8067dbacf3bb\") " pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170232    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-system-cni-dir\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170259    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nvsm\" (UniqueName: \"kubernetes.io/projected/e6eaa37c-12a6-45bd-8507-a6784169b040-kube-api-access-6nvsm\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170267    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-etc-selinux\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-cnibin\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170311    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f12a849a-9067-4be2-903b-f4e80b6c4bee-hosts-file\") pod \"node-resolver-kxxj8\" (UID: \"f12a849a-9067-4be2-903b-f4e80b6c4bee\") " pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-var-lib-cni-multus\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170320    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/23a01417-97d0-4c52-867c-dd9e9567ca4b-kubelet-config\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-etc-kubernetes\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170353    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-hostroot\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170399    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-etc-kubernetes\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170414    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-cnibin\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170430    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6811610c-2544-44eb-ac5b-8067dbacf3bb-host\") pod \"node-ca-wbtx4\" (UID: \"6811610c-2544-44eb-ac5b-8067dbacf3bb\") " pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170474    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-var-lib-cni-multus\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170481    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-system-cni-dir\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170514    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6811610c-2544-44eb-ac5b-8067dbacf3bb-host\") pod \"node-ca-wbtx4\" (UID: \"6811610c-2544-44eb-ac5b-8067dbacf3bb\") " pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-cni-dir\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgb9\" (UniqueName: \"kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9\") pod \"network-check-target-pxm72\" (UID: \"5442c437-24f4-4cd3-9744-b687dc01e17c\") " pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170615    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2d229434-d957-4156-866f-b92159f30e6c-iptables-alerter-script\") pod \"iptables-alerter-dptw6\" (UID: \"2d229434-d957-4156-866f-b92159f30e6c\") " pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170625    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-daemon-config\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170635    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-cni-dir\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170648    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/de9436a0-5a95-46b4-bbbe-91f60647201f-konnectivity-ca\") pod \"konnectivity-agent-dr57n\" (UID: \"de9436a0-5a95-46b4-bbbe-91f60647201f\") " pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170660    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6811610c-2544-44eb-ac5b-8067dbacf3bb-serviceca\") pod \"node-ca-wbtx4\" (UID: \"6811610c-2544-44eb-ac5b-8067dbacf3bb\") " pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170671    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjw4g\" (UniqueName: \"kubernetes.io/projected/f12a849a-9067-4be2-903b-f4e80b6c4bee-kube-api-access-qjw4g\") pod \"node-resolver-kxxj8\" (UID: \"f12a849a-9067-4be2-903b-f4e80b6c4bee\") " pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-os-release\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-cni-binary-copy\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-socket-dir-parent\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170830    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-os-release\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.171678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-sys-fs\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.172323 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-var-lib-kubelet\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.172323 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-run-multus-certs\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.172323 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170911    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e6eaa37c-12a6-45bd-8507-a6784169b040-sys-fs\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.172323 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170942    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-var-lib-kubelet\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.172323 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170949    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-multus-socket-dir-parent\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.172323 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.170961    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-host-run-multus-certs\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.172323 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.171273    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-cni-binary-copy\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.172804 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.172784    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/de9436a0-5a95-46b4-bbbe-91f60647201f-agent-certs\") pod \"konnectivity-agent-dr57n\" (UID: \"de9436a0-5a95-46b4-bbbe-91f60647201f\") " pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:19:58.182587 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.182445    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:19:58.182587 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.182471    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:19:58.182587 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.182485    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8lgb9 for pod openshift-network-diagnostics/network-check-target-pxm72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:19:58.182587 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.182548    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9 podName:5442c437-24f4-4cd3-9744-b687dc01e17c nodeName:}" failed. No retries permitted until 2026-07-06 19:19:58.682531656 +0000 UTC m=+3.055013373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8lgb9" (UniqueName: "kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9") pod "network-check-target-pxm72" (UID: "5442c437-24f4-4cd3-9744-b687dc01e17c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:19:58.183113 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.183092    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdc2b\" (UniqueName: \"kubernetes.io/projected/ae0392f5-77ce-4a4e-8c65-0796ab9317b2-kube-api-access-hdc2b\") pod \"multus-vqfqz\" (UID: \"ae0392f5-77ce-4a4e-8c65-0796ab9317b2\") " pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.184790 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.184761    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nvsm\" (UniqueName: \"kubernetes.io/projected/e6eaa37c-12a6-45bd-8507-a6784169b040-kube-api-access-6nvsm\") pod \"aws-ebs-csi-driver-node-x6pjw\" (UID: \"e6eaa37c-12a6-45bd-8507-a6784169b040\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.185048 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.185030    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjw4g\" (UniqueName: \"kubernetes.io/projected/f12a849a-9067-4be2-903b-f4e80b6c4bee-kube-api-access-qjw4g\") pod \"node-resolver-kxxj8\" (UID: \"f12a849a-9067-4be2-903b-f4e80b6c4bee\") " pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:58.185121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.185050    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fddbd\" (UniqueName: \"kubernetes.io/projected/6811610c-2544-44eb-ac5b-8067dbacf3bb-kube-api-access-fddbd\") pod \"node-ca-wbtx4\" (UID: \"6811610c-2544-44eb-ac5b-8067dbacf3bb\") " pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:58.185276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.185253    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hv8b\" (UniqueName: \"kubernetes.io/projected/2d229434-d957-4156-866f-b92159f30e6c-kube-api-access-2hv8b\") pod \"iptables-alerter-dptw6\" (UID: \"2d229434-d957-4156-866f-b92159f30e6c\") " pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:58.260986 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.260954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-trmsh"
Jul 06 19:19:58.270503 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.270465    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-g75kf"
Jul 06 19:19:58.280291 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.280270    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:19:58.285164 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.285145    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:19:58.291868 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.291848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kxxj8"
Jul 06 19:19:58.300562 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.300537    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wbtx4"
Jul 06 19:19:58.306352 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.306330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vqfqz"
Jul 06 19:19:58.312110 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.312092    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw"
Jul 06 19:19:58.317308 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.317289    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dptw6"
Jul 06 19:19:58.415788 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.415759    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 19:19:58.574011 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.573914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:19:58.574169 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.574077    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:19:58.574169 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.574143    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs podName:0a0cc905-4958-4e00-afc0-8687189c0780 nodeName:}" failed. No retries permitted until 2026-07-06 19:19:59.574126288 +0000 UTC m=+3.946607999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs") pod "network-metrics-daemon-zmz58" (UID: "0a0cc905-4958-4e00-afc0-8687189c0780") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:19:58.674812 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.674776    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:58.674967 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.674937    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:19:58.675017 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.675005    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret podName:23a01417-97d0-4c52-867c-dd9e9567ca4b nodeName:}" failed. No retries permitted until 2026-07-06 19:19:59.674985195 +0000 UTC m=+4.047466909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret") pod "global-pull-secret-syncer-sl8dp" (UID: "23a01417-97d0-4c52-867c-dd9e9567ca4b") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:19:58.775789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:58.775754    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgb9\" (UniqueName: \"kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9\") pod \"network-check-target-pxm72\" (UID: \"5442c437-24f4-4cd3-9744-b687dc01e17c\") " pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:19:58.775972 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.775916    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:19:58.775972 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.775938    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:19:58.775972 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.775947    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8lgb9 for pod openshift-network-diagnostics/network-check-target-pxm72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:19:58.776127 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:58.776001    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9 podName:5442c437-24f4-4cd3-9744-b687dc01e17c nodeName:}" failed. No retries permitted until 2026-07-06 19:19:59.775983872 +0000 UTC m=+4.148465585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lgb9" (UniqueName: "kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9") pod "network-check-target-pxm72" (UID: "5442c437-24f4-4cd3-9744-b687dc01e17c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:19:58.998033 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:58.998009    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a569af_557b_4a76_89bf_65b1b988ceec.slice/crio-d9dfa81e28e85813dc17f458db0321eadd5415abc1943861862bbf00c2ecd94f WatchSource:0}: Error finding container d9dfa81e28e85813dc17f458db0321eadd5415abc1943861862bbf00c2ecd94f: Status 404 returned error can't find the container with id d9dfa81e28e85813dc17f458db0321eadd5415abc1943861862bbf00c2ecd94f
Jul 06 19:19:59.009519 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.009491    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:14:57 +0000 UTC" deadline="2028-04-08 15:22:51.623078388 +0000 UTC"
Jul 06 19:19:59.009519 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.009518    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15404h2m52.613563802s"
Jul 06 19:19:59.018545 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:59.018516    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12a849a_9067_4be2_903b_f4e80b6c4bee.slice/crio-0b78004a8c1e23a92f39f3e4ab14c6dbfb53198900a665d89d8e58087f658a11 WatchSource:0}: Error finding container 0b78004a8c1e23a92f39f3e4ab14c6dbfb53198900a665d89d8e58087f658a11: Status 404 returned error can't find the container with id 0b78004a8c1e23a92f39f3e4ab14c6dbfb53198900a665d89d8e58087f658a11
Jul 06 19:19:59.021619 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:59.021598    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc612c049_b29b_41d4_a65f_36c081c210ec.slice/crio-29d781814d857a5e3eb5bfba3611ed0a27af80b42898805f95b4b66be9152aaa WatchSource:0}: Error finding container 29d781814d857a5e3eb5bfba3611ed0a27af80b42898805f95b4b66be9152aaa: Status 404 returned error can't find the container with id 29d781814d857a5e3eb5bfba3611ed0a27af80b42898805f95b4b66be9152aaa
Jul 06 19:19:59.025238 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:59.025220    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2e3337_5dc8_452a_938f_193dc82597d9.slice/crio-d180f9b1306e0ffdb0106c291c3f56babcf19c9f410b4d6e7be40edf7389324a WatchSource:0}: Error finding container d180f9b1306e0ffdb0106c291c3f56babcf19c9f410b4d6e7be40edf7389324a: Status 404 returned error can't find the container with id d180f9b1306e0ffdb0106c291c3f56babcf19c9f410b4d6e7be40edf7389324a
Jul 06 19:19:59.026415 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:59.026393    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9436a0_5a95_46b4_bbbe_91f60647201f.slice/crio-23457ac2e0fcc5579a1ae2580e0c7db0c6935b06aee62089988d13422e03504a WatchSource:0}: Error finding container 23457ac2e0fcc5579a1ae2580e0c7db0c6935b06aee62089988d13422e03504a: Status 404 returned error can't find the container with id 23457ac2e0fcc5579a1ae2580e0c7db0c6935b06aee62089988d13422e03504a
Jul 06 19:19:59.027842 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:59.027741    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6811610c_2544_44eb_ac5b_8067dbacf3bb.slice/crio-01a1a111c051e54db2b976132aec2ed8419322c44c49f29baaf0d8c2d5c7925f WatchSource:0}: Error finding container 01a1a111c051e54db2b976132aec2ed8419322c44c49f29baaf0d8c2d5c7925f: Status 404 returned error can't find the container with id 01a1a111c051e54db2b976132aec2ed8419322c44c49f29baaf0d8c2d5c7925f
Jul 06 19:19:59.028501 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:59.028463    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6eaa37c_12a6_45bd_8507_a6784169b040.slice/crio-a18bf6cfe9a79f59f43d5117557b8a64e274b26438877d1ac580cec9874de861 WatchSource:0}: Error finding container a18bf6cfe9a79f59f43d5117557b8a64e274b26438877d1ac580cec9874de861: Status 404 returned error can't find the container with id a18bf6cfe9a79f59f43d5117557b8a64e274b26438877d1ac580cec9874de861
Jul 06 19:19:59.029669 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:59.029646    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d229434_d957_4156_866f_b92159f30e6c.slice/crio-0ebaa6183564e230a5a33bcc9ca8920fd87a10c7148a6be91c5be65fc99f55a0 WatchSource:0}: Error finding container 0ebaa6183564e230a5a33bcc9ca8920fd87a10c7148a6be91c5be65fc99f55a0: Status 404 returned error can't find the container with id 0ebaa6183564e230a5a33bcc9ca8920fd87a10c7148a6be91c5be65fc99f55a0
Jul 06 19:19:59.031083 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:19:59.031021    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0392f5_77ce_4a4e_8c65_0796ab9317b2.slice/crio-77bc7cbfdc0501d5138b6eea07e462d2264295004f9a3ca3a4c061952fc9099c WatchSource:0}: Error finding container 77bc7cbfdc0501d5138b6eea07e462d2264295004f9a3ca3a4c061952fc9099c: Status 404 returned error can't find the container with id 77bc7cbfdc0501d5138b6eea07e462d2264295004f9a3ca3a4c061952fc9099c
Jul 06 19:19:59.101717 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.101501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxxj8" event={"ID":"f12a849a-9067-4be2-903b-f4e80b6c4bee","Type":"ContainerStarted","Data":"0b78004a8c1e23a92f39f3e4ab14c6dbfb53198900a665d89d8e58087f658a11"}
Jul 06 19:19:59.102523 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.102502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dptw6" event={"ID":"2d229434-d957-4156-866f-b92159f30e6c","Type":"ContainerStarted","Data":"0ebaa6183564e230a5a33bcc9ca8920fd87a10c7148a6be91c5be65fc99f55a0"}
Jul 06 19:19:59.103517 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.103499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw" event={"ID":"e6eaa37c-12a6-45bd-8507-a6784169b040","Type":"ContainerStarted","Data":"a18bf6cfe9a79f59f43d5117557b8a64e274b26438877d1ac580cec9874de861"}
Jul 06 19:19:59.104778 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.104747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wbtx4" event={"ID":"6811610c-2544-44eb-ac5b-8067dbacf3bb","Type":"ContainerStarted","Data":"01a1a111c051e54db2b976132aec2ed8419322c44c49f29baaf0d8c2d5c7925f"}
Jul 06 19:19:59.105921 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.105874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g75kf" event={"ID":"d6a569af-557b-4a76-89bf-65b1b988ceec","Type":"ContainerStarted","Data":"d9dfa81e28e85813dc17f458db0321eadd5415abc1943861862bbf00c2ecd94f"}
Jul 06 19:19:59.107072 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.106994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vqfqz" event={"ID":"ae0392f5-77ce-4a4e-8c65-0796ab9317b2","Type":"ContainerStarted","Data":"77bc7cbfdc0501d5138b6eea07e462d2264295004f9a3ca3a4c061952fc9099c"}
Jul 06 19:19:59.108115 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.108095    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dr57n" event={"ID":"de9436a0-5a95-46b4-bbbe-91f60647201f","Type":"ContainerStarted","Data":"23457ac2e0fcc5579a1ae2580e0c7db0c6935b06aee62089988d13422e03504a"}
Jul 06 19:19:59.109370 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.109346    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj" event={"ID":"5b2e3337-5dc8-452a-938f-193dc82597d9","Type":"ContainerStarted","Data":"d180f9b1306e0ffdb0106c291c3f56babcf19c9f410b4d6e7be40edf7389324a"}
Jul 06 19:19:59.110449 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.110423    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trmsh" event={"ID":"c612c049-b29b-41d4-a65f-36c081c210ec","Type":"ContainerStarted","Data":"29d781814d857a5e3eb5bfba3611ed0a27af80b42898805f95b4b66be9152aaa"}
Jul 06 19:19:59.581596 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.581562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:19:59.581760 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:59.581728    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:19:59.581831 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:59.581788    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs podName:0a0cc905-4958-4e00-afc0-8687189c0780 nodeName:}" failed. No retries permitted until 2026-07-06 19:20:01.581770834 +0000 UTC m=+5.954252550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs") pod "network-metrics-daemon-zmz58" (UID: "0a0cc905-4958-4e00-afc0-8687189c0780") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:19:59.682076 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.682013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:19:59.682262 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:59.682139    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:19:59.682262 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:59.682200    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret podName:23a01417-97d0-4c52-867c-dd9e9567ca4b nodeName:}" failed. No retries permitted until 2026-07-06 19:20:01.682182612 +0000 UTC m=+6.054664327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret") pod "global-pull-secret-syncer-sl8dp" (UID: "23a01417-97d0-4c52-867c-dd9e9567ca4b") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:19:59.783136 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:19:59.783094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgb9\" (UniqueName: \"kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9\") pod \"network-check-target-pxm72\" (UID: \"5442c437-24f4-4cd3-9744-b687dc01e17c\") " pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:19:59.783315 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:59.783296    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:19:59.783381 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:59.783320    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:19:59.783381 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:59.783332    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8lgb9 for pod openshift-network-diagnostics/network-check-target-pxm72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:19:59.783474 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:19:59.783392    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9 podName:5442c437-24f4-4cd3-9744-b687dc01e17c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:01.783373001 +0000 UTC m=+6.155854728 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lgb9" (UniqueName: "kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9") pod "network-check-target-pxm72" (UID: "5442c437-24f4-4cd3-9744-b687dc01e17c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:20:00.012771 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:00.009876    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:14:57 +0000 UTC" deadline="2028-02-11 03:39:52.88272923 +0000 UTC"
Jul 06 19:20:00.012771 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:00.009933    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14024h19m52.872799611s"
Jul 06 19:20:00.093166 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:00.093133    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:00.093341 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:00.093267    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:00.093693 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:00.093672    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:00.093814 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:00.093792    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:00.093886 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:00.093870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:00.093969 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:00.093953    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:00.122631 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:00.122574    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal" event={"ID":"fc08615788179b892d68aba0ae981b36","Type":"ContainerStarted","Data":"0684e964d01fb0c154b286fb27ac4e0e810e7690c0dfcbf90dafe8666c8868f7"}
Jul 06 19:20:00.130114 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:00.130079    2579 generic.go:356] "Generic (PLEG): container finished" podID="982b49a93d1da23776ac74c818955a1f" containerID="88dbb0e4cb255d8a710a846653ad2a95c1da8db038e94acd52479b80c18fa3f7" exitCode=0
Jul 06 19:20:00.130270 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:00.130139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal" event={"ID":"982b49a93d1da23776ac74c818955a1f","Type":"ContainerDied","Data":"88dbb0e4cb255d8a710a846653ad2a95c1da8db038e94acd52479b80c18fa3f7"}
Jul 06 19:20:00.168620 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:00.168549    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-109.ec2.internal" podStartSLOduration=3.168527616 podStartE2EDuration="3.168527616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:00.149182967 +0000 UTC m=+4.521664713" watchObservedRunningTime="2026-07-06 19:20:00.168527616 +0000 UTC m=+4.541009351"
Jul 06 19:20:01.157569 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:01.157529    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal" event={"ID":"982b49a93d1da23776ac74c818955a1f","Type":"ContainerStarted","Data":"c63499e196ad26e9481b9256b76e5df22a7937e99cb1de4d708907137471d9fb"}
Jul 06 19:20:01.598754 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:01.598655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:01.598928 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:01.598892    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:20:01.598987 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:01.598963    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs podName:0a0cc905-4958-4e00-afc0-8687189c0780 nodeName:}" failed. No retries permitted until 2026-07-06 19:20:05.59894333 +0000 UTC m=+9.971425058 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs") pod "network-metrics-daemon-zmz58" (UID: "0a0cc905-4958-4e00-afc0-8687189c0780") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:20:01.699849 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:01.699807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:01.700042 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:01.699964    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:20:01.700042 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:01.700026    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret podName:23a01417-97d0-4c52-867c-dd9e9567ca4b nodeName:}" failed. No retries permitted until 2026-07-06 19:20:05.700008638 +0000 UTC m=+10.072490352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret") pod "global-pull-secret-syncer-sl8dp" (UID: "23a01417-97d0-4c52-867c-dd9e9567ca4b") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:20:01.800553 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:01.800515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgb9\" (UniqueName: \"kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9\") pod \"network-check-target-pxm72\" (UID: \"5442c437-24f4-4cd3-9744-b687dc01e17c\") " pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:01.800754 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:01.800725    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:20:01.800754 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:01.800750    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:20:01.800867 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:01.800764    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8lgb9 for pod openshift-network-diagnostics/network-check-target-pxm72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:20:01.800867 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:01.800835    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9 podName:5442c437-24f4-4cd3-9744-b687dc01e17c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:05.800816637 +0000 UTC m=+10.173298353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lgb9" (UniqueName: "kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9") pod "network-check-target-pxm72" (UID: "5442c437-24f4-4cd3-9744-b687dc01e17c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:20:02.098395 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:02.098327    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:02.098538 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:02.098453    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:02.098912 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:02.098885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:02.099025 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:02.098993    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:02.099092 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:02.099077    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:02.099175 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:02.099158    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:04.095020 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:04.094982    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:04.095624 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:04.095130    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:04.095624 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:04.095506    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:04.095624 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:04.095608    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:04.095817 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:04.095750    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:04.095890 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:04.095839    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:05.633587 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:05.633428    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:20:05.633587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:05.633476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:05.634117 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:05.633624    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs podName:0a0cc905-4958-4e00-afc0-8687189c0780 nodeName:}" failed. No retries permitted until 2026-07-06 19:20:13.633603471 +0000 UTC m=+18.006085186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs") pod "network-metrics-daemon-zmz58" (UID: "0a0cc905-4958-4e00-afc0-8687189c0780") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:20:05.734650 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:05.734612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:05.734959 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:05.734934    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:20:05.735053 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:05.735019    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret podName:23a01417-97d0-4c52-867c-dd9e9567ca4b nodeName:}" failed. No retries permitted until 2026-07-06 19:20:13.73499856 +0000 UTC m=+18.107480284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret") pod "global-pull-secret-syncer-sl8dp" (UID: "23a01417-97d0-4c52-867c-dd9e9567ca4b") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:20:05.835543 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:05.835500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgb9\" (UniqueName: \"kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9\") pod \"network-check-target-pxm72\" (UID: \"5442c437-24f4-4cd3-9744-b687dc01e17c\") " pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:05.835764 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:05.835723    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:20:05.835764 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:05.835748    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:20:05.835764 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:05.835761    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8lgb9 for pod openshift-network-diagnostics/network-check-target-pxm72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:20:05.835919 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:05.835824    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9 podName:5442c437-24f4-4cd3-9744-b687dc01e17c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:13.835805641 +0000 UTC m=+18.208287371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lgb9" (UniqueName: "kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9") pod "network-check-target-pxm72" (UID: "5442c437-24f4-4cd3-9744-b687dc01e17c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:20:06.094752 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:06.094227    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:06.094752 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:06.094346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:06.094752 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:06.094355    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:06.094752 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:06.094460    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:06.094752 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:06.094504    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:06.094752 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:06.094575    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:08.093480 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:08.093424    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:08.093953 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:08.093423    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:08.093953 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:08.093437    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:08.093953 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:08.093592    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:08.093953 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:08.093679    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:08.093953 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:08.093813    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:10.093737 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:10.093688    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:10.093737 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:10.093738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:10.094249 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:10.093693    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:10.094249 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:10.093825    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:10.094249 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:10.093902    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:10.094249 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:10.093949    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:12.093883 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:12.093844    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:12.094338 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:12.093844    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:12.094338 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:12.093971    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:12.094338 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:12.094044    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:12.094338 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:12.093842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:12.094338 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:12.094134    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:13.697930 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:13.697889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:13.698383 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:13.698039    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:20:13.698383 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:13.698104    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs podName:0a0cc905-4958-4e00-afc0-8687189c0780 nodeName:}" failed. No retries permitted until 2026-07-06 19:20:29.69808877 +0000 UTC m=+34.070570481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs") pod "network-metrics-daemon-zmz58" (UID: "0a0cc905-4958-4e00-afc0-8687189c0780") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:20:13.799189 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:13.799156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:13.799353 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:13.799278    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:20:13.799353 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:13.799331    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret podName:23a01417-97d0-4c52-867c-dd9e9567ca4b nodeName:}" failed. No retries permitted until 2026-07-06 19:20:29.799317724 +0000 UTC m=+34.171799444 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret") pod "global-pull-secret-syncer-sl8dp" (UID: "23a01417-97d0-4c52-867c-dd9e9567ca4b") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:20:13.899618 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:13.899569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgb9\" (UniqueName: \"kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9\") pod \"network-check-target-pxm72\" (UID: \"5442c437-24f4-4cd3-9744-b687dc01e17c\") " pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:13.899807 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:13.899782    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:20:13.899870 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:13.899809    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:20:13.899870 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:13.899823    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8lgb9 for pod openshift-network-diagnostics/network-check-target-pxm72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:20:13.899940 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:13.899888    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9 podName:5442c437-24f4-4cd3-9744-b687dc01e17c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:29.899870566 +0000 UTC m=+34.272352281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lgb9" (UniqueName: "kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9") pod "network-check-target-pxm72" (UID: "5442c437-24f4-4cd3-9744-b687dc01e17c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:20:14.094130 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:14.094041    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:14.094300 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:14.094041    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:14.094300 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:14.094168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:14.094300 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:14.094167    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:14.094300 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:14.094255    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:14.094472 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:14.094335    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:16.094953 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:16.094917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:16.095433 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:16.095019    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:16.095433 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:16.095072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:16.095433 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:16.095080    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:16.095433 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:16.095146    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:16.095433 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:16.095226    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:18.094357 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.094062    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:18.094983 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:18.094441    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:18.094983 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.094111    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:18.094983 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:18.094504    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:18.094983 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.094068    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:18.094983 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:18.094548    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:18.191594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.191552    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wbtx4" event={"ID":"6811610c-2544-44eb-ac5b-8067dbacf3bb","Type":"ContainerStarted","Data":"f214dc6c85782262fa7725b9aed5a57f9baf1363d085444a82880be44f2c2f7e"}
Jul 06 19:20:18.193158 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.193136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-g75kf" event={"ID":"d6a569af-557b-4a76-89bf-65b1b988ceec","Type":"ContainerStarted","Data":"eb328718fe1c16b514ad8461856259514923ee846e9f46867cd4d6fe7fc6340b"}
Jul 06 19:20:18.194988 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.194960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vqfqz" event={"ID":"ae0392f5-77ce-4a4e-8c65-0796ab9317b2","Type":"ContainerStarted","Data":"61d9c0cd8f04677b723ecd0b98056ec393033e49ceb0727f2c469b6f0631c037"}
Jul 06 19:20:18.196558 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.196537    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dr57n" event={"ID":"de9436a0-5a95-46b4-bbbe-91f60647201f","Type":"ContainerStarted","Data":"fbcaab8eb71bf99ecb77f7beff412258d413690b2f2c9dbd20fb7d8b3f7635a9"}
Jul 06 19:20:18.199122 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.199096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj" event={"ID":"5b2e3337-5dc8-452a-938f-193dc82597d9","Type":"ContainerStarted","Data":"41f1aedb4f0960c40fa421682ea45963f141f6bae1f778f4eaff379b30b5099e"}
Jul 06 19:20:18.199198 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.199172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj" event={"ID":"5b2e3337-5dc8-452a-938f-193dc82597d9","Type":"ContainerStarted","Data":"d03696897cde45270fa4a15eb66cc488e479c77f44d22afab920b667f8883b7e"}
Jul 06 19:20:18.200489 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.200470    2579 generic.go:356] "Generic (PLEG): container finished" podID="c612c049-b29b-41d4-a65f-36c081c210ec" containerID="988caf76f55655251b7171795cbf47a5f8df4ea158ee42d04ef0643528e0d096" exitCode=0
Jul 06 19:20:18.200563 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.200529    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trmsh" event={"ID":"c612c049-b29b-41d4-a65f-36c081c210ec","Type":"ContainerDied","Data":"988caf76f55655251b7171795cbf47a5f8df4ea158ee42d04ef0643528e0d096"}
Jul 06 19:20:18.202009 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.201985    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kxxj8" event={"ID":"f12a849a-9067-4be2-903b-f4e80b6c4bee","Type":"ContainerStarted","Data":"ad5076a5f328f49ae380cb956e55c8a178cbd140e8e465aa90e0264929640b3c"}
Jul 06 19:20:18.203580 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.203501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw" event={"ID":"e6eaa37c-12a6-45bd-8507-a6784169b040","Type":"ContainerStarted","Data":"b4637b2490f7694dc920c3910b16f15a29af08eeab0ad68bf8bee8ec2f9ebb9d"}
Jul 06 19:20:18.208291 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.208246    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wbtx4" podStartSLOduration=3.443836451 podStartE2EDuration="22.208233199s" totalImagesPullingTime="18.764396748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:18.207423171 +0000 UTC m=+22.579904905" watchObservedRunningTime="2026-07-06 19:20:18.208233199 +0000 UTC m=+22.580714932"
Jul 06 19:20:18.208390 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.208316    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-109.ec2.internal" podStartSLOduration=21.208310949 podStartE2EDuration="21.208310949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:01.177294717 +0000 UTC m=+5.549776450" watchObservedRunningTime="2026-07-06 19:20:18.208310949 +0000 UTC m=+22.580792677"
Jul 06 19:20:18.258582 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.258535    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vqfqz" podStartSLOduration=3.443609273 podStartE2EDuration="22.258520448s" totalImagesPullingTime="18.814911175s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:18.258280357 +0000 UTC m=+22.630762088" watchObservedRunningTime="2026-07-06 19:20:18.258520448 +0000 UTC m=+22.631002180"
Jul 06 19:20:18.258823 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.258802    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dr57n" podStartSLOduration=11.665911949 podStartE2EDuration="22.258794456s" totalImagesPullingTime="10.592882507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:18.242131347 +0000 UTC m=+22.614613087" watchObservedRunningTime="2026-07-06 19:20:18.258794456 +0000 UTC m=+22.631276256"
Jul 06 19:20:18.274613 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.274576    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-g75kf" podStartSLOduration=3.496457717 podStartE2EDuration="22.274561924s" totalImagesPullingTime="18.778104207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:18.274259963 +0000 UTC m=+22.646741694" watchObservedRunningTime="2026-07-06 19:20:18.274561924 +0000 UTC m=+22.647043674"
Jul 06 19:20:18.289583 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:18.289538    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kxxj8" podStartSLOduration=3.518514267 podStartE2EDuration="22.289521144s" totalImagesPullingTime="18.771006877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:18.289033518 +0000 UTC m=+22.661515251" watchObservedRunningTime="2026-07-06 19:20:18.289521144 +0000 UTC m=+22.662002881"
Jul 06 19:20:19.207242 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:19.207207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dptw6" event={"ID":"2d229434-d957-4156-866f-b92159f30e6c","Type":"ContainerStarted","Data":"3217620eee3f9b497defe1bad1317f9e5f5fbd090c9b303a8fd98bf567007598"}
Jul 06 19:20:19.210325 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:19.210297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj" event={"ID":"5b2e3337-5dc8-452a-938f-193dc82597d9","Type":"ContainerStarted","Data":"a2d701f3833d3908f365924a0c17751f68819774dc4856d2bf356db77d11f592"}
Jul 06 19:20:19.210457 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:19.210379    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj" event={"ID":"5b2e3337-5dc8-452a-938f-193dc82597d9","Type":"ContainerStarted","Data":"2664ddda4e77f65780180c32898908620f53967c6aa3bab63f43f9454317c4d7"}
Jul 06 19:20:19.210457 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:19.210429    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj" event={"ID":"5b2e3337-5dc8-452a-938f-193dc82597d9","Type":"ContainerStarted","Data":"b76dcd86a97bc17e83ae601d93850cc9fa1f0c208c93c3f7d22d5b42209ccd6a"}
Jul 06 19:20:19.210541 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:19.210476    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj" event={"ID":"5b2e3337-5dc8-452a-938f-193dc82597d9","Type":"ContainerStarted","Data":"8f84b83d1cd55e07904ec988dff2e2d4ed9ce1bab5d443b8311afbd2fce7aee9"}
Jul 06 19:20:19.222683 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:19.222631    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dptw6" podStartSLOduration=4.461195567 podStartE2EDuration="23.222612412s" totalImagesPullingTime="18.761416845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:19.222091465 +0000 UTC m=+23.594573197" watchObservedRunningTime="2026-07-06 19:20:19.222612412 +0000 UTC m=+23.595094145"
Jul 06 19:20:19.287892 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:19.287868    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 19:20:20.021838 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:20.021717    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:20:19.287887375Z","UUID":"6195aa78-2b6c-4e36-b9f2-1c1cea4e7235","Handler":null,"Name":"","Endpoint":""}
Jul 06 19:20:20.023461 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:20.023436    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 19:20:20.023589 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:20.023507    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 19:20:20.093463 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:20.093432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:20.093645 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:20.093491    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:20.093645 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:20.093514    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:20.093777 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:20.093653    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:20.093837 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:20.093813    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:20.093938 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:20.093907    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:20.214396 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:20.214363    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw" event={"ID":"e6eaa37c-12a6-45bd-8507-a6784169b040","Type":"ContainerStarted","Data":"6f8faa791a8999e588431243cc292cfac4db5e3b60e119c3d4aa57bd3176e6c0"}
Jul 06 19:20:21.219195 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:21.218997    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw" event={"ID":"e6eaa37c-12a6-45bd-8507-a6784169b040","Type":"ContainerStarted","Data":"780f4243ab3dfb047d2d59ae0345f5519695d675ffce59a6d7ea637377afbc38"}
Jul 06 19:20:21.224466 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:21.224436    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj" event={"ID":"5b2e3337-5dc8-452a-938f-193dc82597d9","Type":"ContainerStarted","Data":"30b3b979ead09fe0043b926f91592d8ec2a51c756fc72bef64f3fd89003e7e23"}
Jul 06 19:20:21.480075 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:21.479987    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:21.584564 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:21.584531    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:22.093504 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:22.093475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:22.093682 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:22.093592    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:22.093682 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:22.093475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:22.093682 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:22.093659    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:22.093682 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:22.093475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:22.093864 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:22.093745    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:22.462569 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:22.462530    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:20:22.463186 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:22.463166    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:20:22.478796 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:22.478743    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x6pjw" podStartSLOduration=5.577785941 podStartE2EDuration="26.478726964s" totalImagesPullingTime="20.900941023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:21.296961921 +0000 UTC m=+25.669443664" watchObservedRunningTime="2026-07-06 19:20:22.478726964 +0000 UTC m=+26.851208711"
Jul 06 19:20:23.229280 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:23.229207    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:20:23.229772 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:23.229751    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dr57n"
Jul 06 19:20:23.298563 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:23.298534    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:23.371722 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:23.371676    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:24.093481 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:24.093449    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:24.093481 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:24.093474    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:24.094255 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:24.093449    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:24.094255 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:24.093601    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:24.094255 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:24.093764    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:24.094255 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:24.093841    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:25.236329 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:25.236127    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj" event={"ID":"5b2e3337-5dc8-452a-938f-193dc82597d9","Type":"ContainerStarted","Data":"b9c67b73f7b6e4e4fb9dd1ab42777f02d613d7d8a3910d975ae4563468bc1ee4"}
Jul 06 19:20:25.236920 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:25.236418    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:20:25.238195 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:25.238168    2579 generic.go:356] "Generic (PLEG): container finished" podID="c612c049-b29b-41d4-a65f-36c081c210ec" containerID="cd97acba4c2dbf23683d902590ba8c556e1ca12270d412a4a9b547276147ba23" exitCode=0
Jul 06 19:20:25.238318 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:25.238238    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trmsh" event={"ID":"c612c049-b29b-41d4-a65f-36c081c210ec","Type":"ContainerDied","Data":"cd97acba4c2dbf23683d902590ba8c556e1ca12270d412a4a9b547276147ba23"}
Jul 06 19:20:25.251897 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:25.251876    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:20:25.262951 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:25.262914    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj" podStartSLOduration=10.432932154 podStartE2EDuration="29.262900164s" totalImagesPullingTime="18.82996801s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:25.261781368 +0000 UTC m=+29.634263099" watchObservedRunningTime="2026-07-06 19:20:25.262900164 +0000 UTC m=+29.635381889"
Jul 06 19:20:26.098127 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.097848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:26.098127 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.097990    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:26.098377 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.098025    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:26.098377 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:26.098217    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:26.098479 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:26.098433    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:26.098618 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:26.098596    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:26.184001 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.183975    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pxm72"]
Jul 06 19:20:26.187442 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.187412    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sl8dp"]
Jul 06 19:20:26.188003 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.187983    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zmz58"]
Jul 06 19:20:26.243495 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.243409    2579 generic.go:356] "Generic (PLEG): container finished" podID="c612c049-b29b-41d4-a65f-36c081c210ec" containerID="76b92e7cb0bd9482f8c2a46f28fa7c4a007685b1a7fb2f8810ec98085331e6c7" exitCode=0
Jul 06 19:20:26.243495 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.243479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:26.243495 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.243481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trmsh" event={"ID":"c612c049-b29b-41d4-a65f-36c081c210ec","Type":"ContainerDied","Data":"76b92e7cb0bd9482f8c2a46f28fa7c4a007685b1a7fb2f8810ec98085331e6c7"}
Jul 06 19:20:26.244008 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.243570    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:26.244008 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:26.243579    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:26.244008 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:26.243681    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:26.244008 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.243863    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:26.244008 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:26.243950    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:26.244869 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.244470    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:20:26.244869 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.244542    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:20:26.259899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.259874    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:20:26.862032 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.861995    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:26.962519 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:26.962482    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:28.094078 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:28.094042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:28.094662 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:28.094042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:28.094662 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:28.094149    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:28.094662 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:28.094050    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:28.094662 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:28.094220    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:28.094662 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:28.094293    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:28.253299 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:28.253268    2579 generic.go:356] "Generic (PLEG): container finished" podID="c612c049-b29b-41d4-a65f-36c081c210ec" containerID="f9040cdaa7a0866b5b6032b5cacc4ccc1f79eb9e410b7f4374588c4c1ab6ee6e" exitCode=0
Jul 06 19:20:28.253460 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:28.253360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trmsh" event={"ID":"c612c049-b29b-41d4-a65f-36c081c210ec","Type":"ContainerDied","Data":"f9040cdaa7a0866b5b6032b5cacc4ccc1f79eb9e410b7f4374588c4c1ab6ee6e"}
Jul 06 19:20:28.961022 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:28.960986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:29.058902 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:29.058874    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:29.718976 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:29.718946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:29.719483 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:29.719097    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:20:29.719483 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:29.719172    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs podName:0a0cc905-4958-4e00-afc0-8687189c0780 nodeName:}" failed. No retries permitted until 2026-07-06 19:21:01.719151412 +0000 UTC m=+66.091633122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs") pod "network-metrics-daemon-zmz58" (UID: "0a0cc905-4958-4e00-afc0-8687189c0780") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 19:20:29.792920 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:29.792858    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:29.819619 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:29.819576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:29.819796 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:29.819753    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 19:20:29.819858 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:29.819830    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret podName:23a01417-97d0-4c52-867c-dd9e9567ca4b nodeName:}" failed. No retries permitted until 2026-07-06 19:21:01.819807235 +0000 UTC m=+66.192288946 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret") pod "global-pull-secret-syncer-sl8dp" (UID: "23a01417-97d0-4c52-867c-dd9e9567ca4b") : object "kube-system"/"original-pull-secret" not registered
Jul 06 19:20:29.920379 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:29.920342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgb9\" (UniqueName: \"kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9\") pod \"network-check-target-pxm72\" (UID: \"5442c437-24f4-4cd3-9744-b687dc01e17c\") " pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:29.920529 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:29.920505    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 19:20:29.920529 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:29.920528    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 19:20:29.920626 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:29.920539    2579 projected.go:196] Error preparing data for projected volume kube-api-access-8lgb9 for pod openshift-network-diagnostics/network-check-target-pxm72: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:20:29.920626 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:29.920598    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9 podName:5442c437-24f4-4cd3-9744-b687dc01e17c nodeName:}" failed. No retries permitted until 2026-07-06 19:21:01.920576834 +0000 UTC m=+66.293058569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lgb9" (UniqueName: "kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9") pod "network-check-target-pxm72" (UID: "5442c437-24f4-4cd3-9744-b687dc01e17c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 19:20:30.094226 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.094136    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:30.094385 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:30.094267    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sl8dp" podUID="23a01417-97d0-4c52-867c-dd9e9567ca4b"
Jul 06 19:20:30.094510 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.094467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:30.094626 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.094596    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:30.094689 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:30.094657    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pxm72" podUID="5442c437-24f4-4cd3-9744-b687dc01e17c"
Jul 06 19:20:30.094689 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:30.094593    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zmz58" podUID="0a0cc905-4958-4e00-afc0-8687189c0780"
Jul 06 19:20:30.912900 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.912873    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-109.ec2.internal" event="NodeReady"
Jul 06 19:20:30.913267 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.913003    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 19:20:30.973579 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.973546    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58d87b89cb-jlm2j"]
Jul 06 19:20:30.978865 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.978842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:30.983041 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.982769    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 19:20:30.983041 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.982778    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 19:20:30.983409 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.983367    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 19:20:30.983581 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.983367    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zrfbt\""
Jul 06 19:20:30.984112 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.984090    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pt8fk"]
Jul 06 19:20:30.989623 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.989582    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:30.990839 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.990536    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 19:20:30.992361 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.992335    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-w5krb"]
Jul 06 19:20:30.996423 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.996404    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w5krb"
Jul 06 19:20:30.996683 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.996665    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 19:20:30.996860 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.996521    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 19:20:30.997200 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.997182    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-r5ggw\""
Jul 06 19:20:30.998695 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:30.998672    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58d87b89cb-jlm2j"]
Jul 06 19:20:31.003251 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.003230    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 19:20:31.003476 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.003456    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 19:20:31.003600 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.003477    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jkg7b\""
Jul 06 19:20:31.003600 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.003456    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 19:20:31.008836 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.008814    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pt8fk"]
Jul 06 19:20:31.013285 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.013264    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w5krb"]
Jul 06 19:20:31.130683 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.130649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fd2e990-bc6f-4ac2-aa58-7de953608358-tmp-dir\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.130683 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.130686    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-installation-pull-secrets\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.130907 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.130729    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcgkp\" (UniqueName: \"kubernetes.io/projected/328b6e75-67f1-459f-8b89-5065d5fffe19-kube-api-access-qcgkp\") pod \"ingress-canary-w5krb\" (UID: \"328b6e75-67f1-459f-8b89-5065d5fffe19\") " pod="openshift-ingress-canary/ingress-canary-w5krb"
Jul 06 19:20:31.130907 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.130777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fff503cd-910d-45f9-b7d2-97301c65179a-ca-trust-extracted\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.130907 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.130795    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd2e990-bc6f-4ac2-aa58-7de953608358-config-volume\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.130907 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.130812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t72g5\" (UniqueName: \"kubernetes.io/projected/8fd2e990-bc6f-4ac2-aa58-7de953608358-kube-api-access-t72g5\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.130907 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.130830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57rjc\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-kube-api-access-57rjc\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.130907 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.130853    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.131247 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.130924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-bound-sa-token\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.131247 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.130966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-trusted-ca\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.131247 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.131000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/328b6e75-67f1-459f-8b89-5065d5fffe19-cert\") pod \"ingress-canary-w5krb\" (UID: \"328b6e75-67f1-459f-8b89-5065d5fffe19\") " pod="openshift-ingress-canary/ingress-canary-w5krb"
Jul 06 19:20:31.131247 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.131061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-image-registry-private-configuration\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.131247 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.131095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.131247 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.131138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-registry-certificates\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.165921 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.165659    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:31.232345 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232311    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/328b6e75-67f1-459f-8b89-5065d5fffe19-cert\") pod \"ingress-canary-w5krb\" (UID: \"328b6e75-67f1-459f-8b89-5065d5fffe19\") " pod="openshift-ingress-canary/ingress-canary-w5krb"
Jul 06 19:20:31.232531 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-image-registry-private-configuration\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.232531 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232419    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.232531 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232441    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-registry-certificates\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.232531 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fd2e990-bc6f-4ac2-aa58-7de953608358-tmp-dir\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.232531 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232494    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-installation-pull-secrets\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.232531 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgkp\" (UniqueName: \"kubernetes.io/projected/328b6e75-67f1-459f-8b89-5065d5fffe19-kube-api-access-qcgkp\") pod \"ingress-canary-w5krb\" (UID: \"328b6e75-67f1-459f-8b89-5065d5fffe19\") " pod="openshift-ingress-canary/ingress-canary-w5krb"
Jul 06 19:20:31.232837 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fff503cd-910d-45f9-b7d2-97301c65179a-ca-trust-extracted\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.232837 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd2e990-bc6f-4ac2-aa58-7de953608358-config-volume\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.232837 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t72g5\" (UniqueName: \"kubernetes.io/projected/8fd2e990-bc6f-4ac2-aa58-7de953608358-kube-api-access-t72g5\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.232837 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57rjc\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-kube-api-access-57rjc\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.232837 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.232837 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232680    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-bound-sa-token\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.232837 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.232726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-trusted-ca\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.232837 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:31.232779    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:20:31.232837 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:31.232800    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d87b89cb-jlm2j: secret "image-registry-tls" not found
Jul 06 19:20:31.233214 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:31.232871    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls podName:fff503cd-910d-45f9-b7d2-97301c65179a nodeName:}" failed. No retries permitted until 2026-07-06 19:20:31.73285163 +0000 UTC m=+36.105333341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls") pod "image-registry-58d87b89cb-jlm2j" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a") : secret "image-registry-tls" not found
Jul 06 19:20:31.233214 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.233049    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8fd2e990-bc6f-4ac2-aa58-7de953608358-tmp-dir\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.233214 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:31.233138    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:20:31.233214 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:31.233193    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls podName:8fd2e990-bc6f-4ac2-aa58-7de953608358 nodeName:}" failed. No retries permitted until 2026-07-06 19:20:31.73317713 +0000 UTC m=+36.105658847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls") pod "dns-default-pt8fk" (UID: "8fd2e990-bc6f-4ac2-aa58-7de953608358") : secret "dns-default-metrics-tls" not found
Jul 06 19:20:31.233415 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.233388    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fff503cd-910d-45f9-b7d2-97301c65179a-ca-trust-extracted\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.233415 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.233402    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-registry-certificates\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.233894 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.233859    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8fd2e990-bc6f-4ac2-aa58-7de953608358-config-volume\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.234384 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.234359    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-trusted-ca\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.237354 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.237328    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-image-registry-private-configuration\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.237452 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.237325    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-installation-pull-secrets\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.237886 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.237869    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/328b6e75-67f1-459f-8b89-5065d5fffe19-cert\") pod \"ingress-canary-w5krb\" (UID: \"328b6e75-67f1-459f-8b89-5065d5fffe19\") " pod="openshift-ingress-canary/ingress-canary-w5krb"
Jul 06 19:20:31.255897 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.255873    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-bound-sa-token\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.259169 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.259141    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t72g5\" (UniqueName: \"kubernetes.io/projected/8fd2e990-bc6f-4ac2-aa58-7de953608358-kube-api-access-t72g5\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.259973 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.259937    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57rjc\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-kube-api-access-57rjc\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.261041 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.260991    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcgkp\" (UniqueName: \"kubernetes.io/projected/328b6e75-67f1-459f-8b89-5065d5fffe19-kube-api-access-qcgkp\") pod \"ingress-canary-w5krb\" (UID: \"328b6e75-67f1-459f-8b89-5065d5fffe19\") " pod="openshift-ingress-canary/ingress-canary-w5krb"
Jul 06 19:20:31.291500 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.291468    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:31.309497 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.309467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-w5krb"
Jul 06 19:20:31.737965 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.737931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:31.738152 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:31.738011    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:31.738152 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:31.738105    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:20:31.738152 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:31.738118    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:20:31.738152 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:31.738125    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d87b89cb-jlm2j: secret "image-registry-tls" not found
Jul 06 19:20:31.738334 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:31.738186    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls podName:fff503cd-910d-45f9-b7d2-97301c65179a nodeName:}" failed. No retries permitted until 2026-07-06 19:20:32.738165589 +0000 UTC m=+37.110647351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls") pod "image-registry-58d87b89cb-jlm2j" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a") : secret "image-registry-tls" not found
Jul 06 19:20:31.738334 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:31.738200    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls podName:8fd2e990-bc6f-4ac2-aa58-7de953608358 nodeName:}" failed. No retries permitted until 2026-07-06 19:20:32.738194263 +0000 UTC m=+37.110675973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls") pod "dns-default-pt8fk" (UID: "8fd2e990-bc6f-4ac2-aa58-7de953608358") : secret "dns-default-metrics-tls" not found
Jul 06 19:20:32.092634 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.092553    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:32.093317 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.093296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:20:32.093409 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.093297    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:20:32.093676 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.093297    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:20:32.097078 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.097055    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:20:32.097784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.097630    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:20:32.097784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.097641    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:20:32.097784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.097650    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c88qg\""
Jul 06 19:20:32.097784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.097675    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:20:32.098017 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.097789    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r9p6l\""
Jul 06 19:20:32.251099 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.251064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:32.387306 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.387271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:32.538197 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.538134    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:32.570236 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.570211    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-w5krb"]
Jul 06 19:20:32.574061 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:20:32.574038    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod328b6e75_67f1_459f_8b89_5065d5fffe19.slice/crio-e15b1f4e74bfab12f73126da8099d2d4e75e436b298e9287dce6e6ffcdc8225c WatchSource:0}: Error finding container e15b1f4e74bfab12f73126da8099d2d4e75e436b298e9287dce6e6ffcdc8225c: Status 404 returned error can't find the container with id e15b1f4e74bfab12f73126da8099d2d4e75e436b298e9287dce6e6ffcdc8225c
Jul 06 19:20:32.582964 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.582942    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl"]
Jul 06 19:20:32.585656 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.585632    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl"
Jul 06 19:20:32.588051 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.588030    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 06 19:20:32.588140 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.588053    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 06 19:20:32.588140 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.588069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jnkz7\""
Jul 06 19:20:32.596330 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.596302    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl"]
Jul 06 19:20:32.626685 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.626650    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:32.686262 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.686219    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:32.745765 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.745726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:32.745903 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.745776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xqmm\" (UniqueName: \"kubernetes.io/projected/3901c6da-4f8e-4299-9e93-3c1ce8214553-kube-api-access-6xqmm\") pod \"migrator-d57d58cc9-bvdkl\" (UID: \"3901c6da-4f8e-4299-9e93-3c1ce8214553\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl"
Jul 06 19:20:32.745903 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.745843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:32.745903 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:32.745887    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:20:32.746009 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:32.745946    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls podName:8fd2e990-bc6f-4ac2-aa58-7de953608358 nodeName:}" failed. No retries permitted until 2026-07-06 19:20:34.745927976 +0000 UTC m=+39.118409690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls") pod "dns-default-pt8fk" (UID: "8fd2e990-bc6f-4ac2-aa58-7de953608358") : secret "dns-default-metrics-tls" not found
Jul 06 19:20:32.746009 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:32.745967    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:20:32.746009 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:32.745979    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d87b89cb-jlm2j: secret "image-registry-tls" not found
Jul 06 19:20:32.746009 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:32.746009    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls podName:fff503cd-910d-45f9-b7d2-97301c65179a nodeName:}" failed. No retries permitted until 2026-07-06 19:20:34.745998542 +0000 UTC m=+39.118480271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls") pod "image-registry-58d87b89cb-jlm2j" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a") : secret "image-registry-tls" not found
Jul 06 19:20:32.789071 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.789040    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:32.846361 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.846331    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xqmm\" (UniqueName: \"kubernetes.io/projected/3901c6da-4f8e-4299-9e93-3c1ce8214553-kube-api-access-6xqmm\") pod \"migrator-d57d58cc9-bvdkl\" (UID: \"3901c6da-4f8e-4299-9e93-3c1ce8214553\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl"
Jul 06 19:20:32.857085 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.857057    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xqmm\" (UniqueName: \"kubernetes.io/projected/3901c6da-4f8e-4299-9e93-3c1ce8214553-kube-api-access-6xqmm\") pod \"migrator-d57d58cc9-bvdkl\" (UID: \"3901c6da-4f8e-4299-9e93-3c1ce8214553\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl"
Jul 06 19:20:32.898955 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:32.898933    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl"
Jul 06 19:20:33.028123 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.027905    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl"]
Jul 06 19:20:33.031625 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:20:33.031595    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3901c6da_4f8e_4299_9e93_3c1ce8214553.slice/crio-95627a370882aab87f5263dcc0736437474e55020aab50c6c78a0e7a6f871a43 WatchSource:0}: Error finding container 95627a370882aab87f5263dcc0736437474e55020aab50c6c78a0e7a6f871a43: Status 404 returned error can't find the container with id 95627a370882aab87f5263dcc0736437474e55020aab50c6c78a0e7a6f871a43
Jul 06 19:20:33.134805 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.134767    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:33.202407 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.202314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:33.270285 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.270256    2579 generic.go:356] "Generic (PLEG): container finished" podID="c612c049-b29b-41d4-a65f-36c081c210ec" containerID="739bcd14c5864fd8ab9191fcc1a0db14f203ee1113bb343ce99a0aa2cbcf08d0" exitCode=0
Jul 06 19:20:33.270460 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.270347    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trmsh" event={"ID":"c612c049-b29b-41d4-a65f-36c081c210ec","Type":"ContainerDied","Data":"739bcd14c5864fd8ab9191fcc1a0db14f203ee1113bb343ce99a0aa2cbcf08d0"}
Jul 06 19:20:33.271619 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.271583    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl" event={"ID":"3901c6da-4f8e-4299-9e93-3c1ce8214553","Type":"ContainerStarted","Data":"95627a370882aab87f5263dcc0736437474e55020aab50c6c78a0e7a6f871a43"}
Jul 06 19:20:33.272807 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.272770    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w5krb" event={"ID":"328b6e75-67f1-459f-8b89-5065d5fffe19","Type":"ContainerStarted","Data":"e15b1f4e74bfab12f73126da8099d2d4e75e436b298e9287dce6e6ffcdc8225c"}
Jul 06 19:20:33.346043 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.346015    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wxdtr"]
Jul 06 19:20:33.351242 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.351219    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.356621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.356226    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 19:20:33.356621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.356431    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 19:20:33.356621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.356433    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 19:20:33.356621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.356554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 19:20:33.356916 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.356782    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2lnlz\""
Jul 06 19:20:33.363442 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.363419    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wxdtr"]
Jul 06 19:20:33.412548 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.412516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:33.450778 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.450733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1918e148-d6fc-4023-9b40-e5de68ddea1c-crio-socket\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.450923 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.450857    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1918e148-d6fc-4023-9b40-e5de68ddea1c-data-volume\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.450923 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.450887    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.451222 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.451136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmrwl\" (UniqueName: \"kubernetes.io/projected/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-api-access-pmrwl\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.451222 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.451183    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.507949 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.507850    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:33.551832 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.551797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.551966 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.551846    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1918e148-d6fc-4023-9b40-e5de68ddea1c-crio-socket\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.551966 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.551897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1918e148-d6fc-4023-9b40-e5de68ddea1c-data-volume\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.551966 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:33.551902    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:20:33.551966 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.551915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.552145 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:33.551976    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:34.051959063 +0000 UTC m=+38.424440773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : configmap "kube-rbac-proxy" not found
Jul 06 19:20:33.552145 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.551999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmrwl\" (UniqueName: \"kubernetes.io/projected/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-api-access-pmrwl\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.552145 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:33.552037    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:33.552145 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:33.552086    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:34.052070343 +0000 UTC m=+38.424552053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:33.552145 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.552116    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1918e148-d6fc-4023-9b40-e5de68ddea1c-crio-socket\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.552351 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.552220    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1918e148-d6fc-4023-9b40-e5de68ddea1c-data-volume\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:33.561212 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:33.561184    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmrwl\" (UniqueName: \"kubernetes.io/projected/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-api-access-pmrwl\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:34.057125 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:34.057090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:34.057298 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:34.057193    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:34.057298 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:34.057277    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:34.057298 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:34.057291    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:20:34.057424 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:34.057351    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:35.057337538 +0000 UTC m=+39.429819247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : configmap "kube-rbac-proxy" not found
Jul 06 19:20:34.057424 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:34.057372    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:35.057362917 +0000 UTC m=+39.429844627 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:34.240269 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:34.240225    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:34.279946 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:34.279909    2579 generic.go:356] "Generic (PLEG): container finished" podID="c612c049-b29b-41d4-a65f-36c081c210ec" containerID="53aca53fe8c02062cc9939459eb79886c9a0637d07ebe2f1cfb2f939b3e2cd03" exitCode=0
Jul 06 19:20:34.280132 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:34.279975    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trmsh" event={"ID":"c612c049-b29b-41d4-a65f-36c081c210ec","Type":"ContainerDied","Data":"53aca53fe8c02062cc9939459eb79886c9a0637d07ebe2f1cfb2f939b3e2cd03"}
Jul 06 19:20:34.303829 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:34.303796    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:34.764365 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:34.764324    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:34.764536 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:34.764428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:34.764536 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:34.764494    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:20:34.764536 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:34.764519    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d87b89cb-jlm2j: secret "image-registry-tls" not found
Jul 06 19:20:34.764686 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:34.764579    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:20:34.764686 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:34.764589    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls podName:fff503cd-910d-45f9-b7d2-97301c65179a nodeName:}" failed. No retries permitted until 2026-07-06 19:20:38.764568687 +0000 UTC m=+43.137050400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls") pod "image-registry-58d87b89cb-jlm2j" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a") : secret "image-registry-tls" not found
Jul 06 19:20:34.764686 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:34.764630    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls podName:8fd2e990-bc6f-4ac2-aa58-7de953608358 nodeName:}" failed. No retries permitted until 2026-07-06 19:20:38.764615233 +0000 UTC m=+43.137096948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls") pod "dns-default-pt8fk" (UID: "8fd2e990-bc6f-4ac2-aa58-7de953608358") : secret "dns-default-metrics-tls" not found
Jul 06 19:20:35.006312 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.006272    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hz9pp"]
Jul 06 19:20:35.019215 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.019135    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.021162 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.021133    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hz9pp"]
Jul 06 19:20:35.021803 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.021776    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pfxm4\""
Jul 06 19:20:35.021914 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.021895    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 19:20:35.022834 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.022814    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 19:20:35.022931 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.022816    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 19:20:35.023164 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.023112    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 19:20:35.026810 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.026771    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:35.067505 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.067470    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:35.067696 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.067565    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:35.067696 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:35.067642    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:35.067696 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:35.067682    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:20:35.067696 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:35.067721    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:37.067690025 +0000 UTC m=+41.440171734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:35.067909 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:35.067768    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:37.067751047 +0000 UTC m=+41.440232772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : configmap "kube-rbac-proxy" not found
Jul 06 19:20:35.090570 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.090530    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:35.168069 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.168031    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6-signing-cabundle\") pod \"service-ca-758f599c5-hz9pp\" (UID: \"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6\") " pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.168239 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.168124    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6-signing-key\") pod \"service-ca-758f599c5-hz9pp\" (UID: \"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6\") " pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.168239 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.168148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q57wf\" (UniqueName: \"kubernetes.io/projected/2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6-kube-api-access-q57wf\") pod \"service-ca-758f599c5-hz9pp\" (UID: \"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6\") " pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.269006 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.268976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6-signing-cabundle\") pod \"service-ca-758f599c5-hz9pp\" (UID: \"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6\") " pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.269376 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.269053    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6-signing-key\") pod \"service-ca-758f599c5-hz9pp\" (UID: \"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6\") " pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.269376 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.269071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q57wf\" (UniqueName: \"kubernetes.io/projected/2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6-kube-api-access-q57wf\") pod \"service-ca-758f599c5-hz9pp\" (UID: \"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6\") " pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.269566 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.269542    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6-signing-cabundle\") pod \"service-ca-758f599c5-hz9pp\" (UID: \"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6\") " pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.271402 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.271381    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6-signing-key\") pod \"service-ca-758f599c5-hz9pp\" (UID: \"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6\") " pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.276548 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.276524    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q57wf\" (UniqueName: \"kubernetes.io/projected/2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6-kube-api-access-q57wf\") pod \"service-ca-758f599c5-hz9pp\" (UID: \"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6\") " pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.331245 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.331212    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-hz9pp"
Jul 06 19:20:35.711365 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.711328    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-hz9pp"]
Jul 06 19:20:35.714794 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:20:35.714770    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2959f981_72ad_4c01_bb1f_bc9bfd6b1cc6.slice/crio-b4b729c7392966e02560884132d379b563bf273bebf05f5f377a7dba45be2493 WatchSource:0}: Error finding container b4b729c7392966e02560884132d379b563bf273bebf05f5f377a7dba45be2493: Status 404 returned error can't find the container with id b4b729c7392966e02560884132d379b563bf273bebf05f5f377a7dba45be2493
Jul 06 19:20:35.751512 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:35.751482    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxxj8_f12a849a-9067-4be2-903b-f4e80b6c4bee/dns-node-resolver/0.log"
Jul 06 19:20:36.045919 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:36.045837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:36.289757 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:36.289715    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-trmsh" event={"ID":"c612c049-b29b-41d4-a65f-36c081c210ec","Type":"ContainerStarted","Data":"73cc0fe7039765b2c07119a65c0c7b8c8f76a71eb14a981d6a81d62987a051e1"}
Jul 06 19:20:36.291686 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:36.291658    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl" event={"ID":"3901c6da-4f8e-4299-9e93-3c1ce8214553","Type":"ContainerStarted","Data":"467967d43a203e61e14f4ad23b3147cb0b4ec40501048fa382c4e0264871d3ed"}
Jul 06 19:20:36.291834 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:36.291761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl" event={"ID":"3901c6da-4f8e-4299-9e93-3c1ce8214553","Type":"ContainerStarted","Data":"15ce069e416bc2c1f43a2ef1c49adc66065d09e10791b93c1cd42d807cb367b9"}
Jul 06 19:20:36.293159 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:36.293133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-w5krb" event={"ID":"328b6e75-67f1-459f-8b89-5065d5fffe19","Type":"ContainerStarted","Data":"50df52e4305f101c5240c9d48289ac6dd96e100764356928fc6e2072810d24b6"}
Jul 06 19:20:36.294470 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:36.294446    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-hz9pp" event={"ID":"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6","Type":"ContainerStarted","Data":"b4b729c7392966e02560884132d379b563bf273bebf05f5f377a7dba45be2493"}
Jul 06 19:20:36.322990 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:36.322892    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-trmsh" podStartSLOduration=9.372000415 podStartE2EDuration="40.322875213s" totalImagesPullingTime="30.950874798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:36.321453276 +0000 UTC m=+40.693935008" watchObservedRunningTime="2026-07-06 19:20:36.322875213 +0000 UTC m=+40.695356948"
Jul 06 19:20:36.341949 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:36.341902    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-bvdkl" podStartSLOduration=1.796582916 podStartE2EDuration="4.341887349s" totalImagesPullingTime="2.545304433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:36.341108151 +0000 UTC m=+40.713589994" watchObservedRunningTime="2026-07-06 19:20:36.341887349 +0000 UTC m=+40.714369081"
Jul 06 19:20:36.360356 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:36.360311    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-w5krb" podStartSLOduration=3.361185683 podStartE2EDuration="6.360297536s" totalImagesPullingTime="2.999111853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:36.35997392 +0000 UTC m=+40.732455655" watchObservedRunningTime="2026-07-06 19:20:36.360297536 +0000 UTC m=+40.732779303"
Jul 06 19:20:36.930629 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:36.930569    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wbtx4_6811610c-2544-44eb-ac5b-8067dbacf3bb/node-ca/0.log"
Jul 06 19:20:37.084464 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:37.084429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:37.084668 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:37.084543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:37.084668 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:37.084627    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:20:37.084824 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:37.084670    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:37.084824 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:37.084760    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:41.084738043 +0000 UTC m=+45.457219759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:37.084824 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:37.084788    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:41.084778292 +0000 UTC m=+45.457260001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : configmap "kube-rbac-proxy" not found
Jul 06 19:20:37.530755 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:37.530718    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w5krb_328b6e75-67f1-459f-8b89-5065d5fffe19/serve-healthcheck-canary/0.log"
Jul 06 19:20:37.731051 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:37.731018    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bvdkl_3901c6da-4f8e-4299-9e93-3c1ce8214553/migrator/0.log"
Jul 06 19:20:37.928963 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:37.928941    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bvdkl_3901c6da-4f8e-4299-9e93-3c1ce8214553/graceful-termination/0.log"
Jul 06 19:20:38.797909 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:38.797866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:38.798359 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:38.797961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:38.798359 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:38.798006    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 19:20:38.798359 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:38.798026    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58d87b89cb-jlm2j: secret "image-registry-tls" not found
Jul 06 19:20:38.798359 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:38.798077    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls podName:fff503cd-910d-45f9-b7d2-97301c65179a nodeName:}" failed. No retries permitted until 2026-07-06 19:20:46.798063778 +0000 UTC m=+51.170545488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls") pod "image-registry-58d87b89cb-jlm2j" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a") : secret "image-registry-tls" not found
Jul 06 19:20:38.798359 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:38.798089    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 19:20:38.798359 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:38.798138    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls podName:8fd2e990-bc6f-4ac2-aa58-7de953608358 nodeName:}" failed. No retries permitted until 2026-07-06 19:20:46.798123998 +0000 UTC m=+51.170605708 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls") pod "dns-default-pt8fk" (UID: "8fd2e990-bc6f-4ac2-aa58-7de953608358") : secret "dns-default-metrics-tls" not found
Jul 06 19:20:39.303559 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:39.303518    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-hz9pp" event={"ID":"2959f981-72ad-4c01-bb1f-bc9bfd6b1cc6","Type":"ContainerStarted","Data":"f4b651316d4446a5774862ee91b7891c0afbde8893c0e5ba5e859d9db262bb91"}
Jul 06 19:20:39.492584 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:39.492544    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:39.777802 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:39.777694    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:39.858279 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:39.858238    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:39.953572 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:39.953538    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:40.053930 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:40.053844    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:40.227228 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:40.227190    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:40.795977 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:40.795945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:41.116781 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:41.116751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:41.117140 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:41.116834    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:41.117140 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:41.116868    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 19:20:41.117140 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:41.116930    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:49.116915942 +0000 UTC m=+53.489397652 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : configmap "kube-rbac-proxy" not found
Jul 06 19:20:41.117140 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:41.116940    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:41.117140 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:41.116983    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:20:49.116970042 +0000 UTC m=+53.489451752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:41.453611 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:41.453518    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:41.980170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:41.980135    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:42.184815 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:42.184773    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:42.243328 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:42.243241    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:42.581226 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:42.581128    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:42.775561 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:42.775524    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:43.177156 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:43.177123    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:43.230664 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:43.230631    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:43.681560 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:43.681522    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:43.975469 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:43.975384    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:44.383167 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:44.383135    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:44.443762 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:44.443731    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:44.587632 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:44.587601    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:44.686551 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:44.686453    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:44.786623 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:44.786583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:44.849550 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:44.849513    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:45.188537 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:45.188504    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:45.662932 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:45.662897    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:45.778519 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:45.778486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:46.375828 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:46.375790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:46.575450 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:46.575409    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:46.791666 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:46.791571    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:46.864086 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:46.864046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:46.864254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:46.864125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:46.866412 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:46.866379    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8fd2e990-bc6f-4ac2-aa58-7de953608358-metrics-tls\") pod \"dns-default-pt8fk\" (UID: \"8fd2e990-bc6f-4ac2-aa58-7de953608358\") " pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:46.866566 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:46.866513    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls\") pod \"image-registry-58d87b89cb-jlm2j\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") " pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:46.892913 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:46.892621    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:46.901527 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:46.901491    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:46.984571 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:46.984471    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:47.060250 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.060147    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-hz9pp" podStartSLOduration=10.542964704 podStartE2EDuration="13.060125067s" totalImagesPullingTime="2.517160363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:39.323450646 +0000 UTC m=+43.695932396" watchObservedRunningTime="2026-07-06 19:20:47.060125067 +0000 UTC m=+51.432606797"
Jul 06 19:20:47.060796 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.060769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58d87b89cb-jlm2j"]
Jul 06 19:20:47.063348 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:20:47.063318    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff503cd_910d_45f9_b7d2_97301c65179a.slice/crio-24b69421c7f10a1f7f21b899e360a9bd8c90e9fcd762734a5676978428e9b633 WatchSource:0}: Error finding container 24b69421c7f10a1f7f21b899e360a9bd8c90e9fcd762734a5676978428e9b633: Status 404 returned error can't find the container with id 24b69421c7f10a1f7f21b899e360a9bd8c90e9fcd762734a5676978428e9b633
Jul 06 19:20:47.076680 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.076601    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pt8fk"]
Jul 06 19:20:47.081900 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:20:47.081881    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd2e990_bc6f_4ac2_aa58_7de953608358.slice/crio-f0ccf8b98e83677e0d2ca56488b869fdb9dcd29c37ab511b8337fbfc691046c7 WatchSource:0}: Error finding container f0ccf8b98e83677e0d2ca56488b869fdb9dcd29c37ab511b8337fbfc691046c7: Status 404 returned error can't find the container with id f0ccf8b98e83677e0d2ca56488b869fdb9dcd29c37ab511b8337fbfc691046c7
Jul 06 19:20:47.144122 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.144096    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:47.244616 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.244580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:47.325830 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.325732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j" event={"ID":"fff503cd-910d-45f9-b7d2-97301c65179a","Type":"ContainerStarted","Data":"ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd"}
Jul 06 19:20:47.325830 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.325793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j" event={"ID":"fff503cd-910d-45f9-b7d2-97301c65179a","Type":"ContainerStarted","Data":"24b69421c7f10a1f7f21b899e360a9bd8c90e9fcd762734a5676978428e9b633"}
Jul 06 19:20:47.325830 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.325823    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:20:47.326820 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.326792    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pt8fk" event={"ID":"8fd2e990-bc6f-4ac2-aa58-7de953608358","Type":"ContainerStarted","Data":"f0ccf8b98e83677e0d2ca56488b869fdb9dcd29c37ab511b8337fbfc691046c7"}
Jul 06 19:20:47.346896 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.346843    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j" podStartSLOduration=31.346822272 podStartE2EDuration="31.346822272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:47.346003269 +0000 UTC m=+51.718485016" watchObservedRunningTime="2026-07-06 19:20:47.346822272 +0000 UTC m=+51.719304005"
Jul 06 19:20:47.585908 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:47.585820    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:48.185910 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:48.185868    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:48.583382 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:48.583260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:48.975953 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:48.975917    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:49.176473 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:49.176414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:49.183432 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:49.183397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:49.183608 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:49.183505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:49.183671 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:49.183628    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:49.183763 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:20:49.183692    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls podName:1918e148-d6fc-4023-9b40-e5de68ddea1c nodeName:}" failed. No retries permitted until 2026-07-06 19:21:05.183674877 +0000 UTC m=+69.556156591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wxdtr" (UID: "1918e148-d6fc-4023-9b40-e5de68ddea1c") : secret "insights-runtime-extractor-tls" not found
Jul 06 19:20:49.184046 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:49.184023    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1918e148-d6fc-4023-9b40-e5de68ddea1c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:20:49.780269 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:49.780238    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:49.981243 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:49.981218    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:50.081143 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:50.081121    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:50.181566 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:50.181536    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:50.283372 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:50.283337    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:50.338143 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:50.338068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pt8fk" event={"ID":"8fd2e990-bc6f-4ac2-aa58-7de953608358","Type":"ContainerStarted","Data":"9b0e439380af58cb44e4f6594b8f323cd9f83d309a5e68ec98bd6a8b0202cd84"}
Jul 06 19:20:50.338143 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:50.338120    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pt8fk" event={"ID":"8fd2e990-bc6f-4ac2-aa58-7de953608358","Type":"ContainerStarted","Data":"667f214b8f2fa456e8d2c82624ddd6432b117cdaf7fe0eae6e957d155b3a588f"}
Jul 06 19:20:50.338308 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:50.338181    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:20:56.041931 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:56.041893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:56.138505 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:56.138469    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:56.196516 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:56.196487    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:56.339689 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:56.339582    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:56.705393 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:56.705361    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:56.806218 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:56.806183    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:57.133603 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:57.133574    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:57.235156 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:57.235122    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:57.345426 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:57.345390    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:57.404394 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:57.404319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:57.917796 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:57.917751    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:58.119205 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.119168    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:58.264084 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.264013    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jm6bj"
Jul 06 19:20:58.297718 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.297658    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pt8fk" podStartSLOduration=25.406328224 podStartE2EDuration="28.297643274s" totalImagesPullingTime="2.89131505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:50.356006692 +0000 UTC m=+54.728488431" watchObservedRunningTime="2026-07-06 19:20:58.297643274 +0000 UTC m=+62.670125006"
Jul 06 19:20:58.561408 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.561327    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"]
Jul 06 19:20:58.564156 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.564142    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"
Jul 06 19:20:58.566861 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.566840    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 19:20:58.567317 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.567295    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 19:20:58.567429 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.567304    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m67hq\""
Jul 06 19:20:58.567863 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.567847    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"]
Jul 06 19:20:58.569740 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.569724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.572007 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.571992    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 06 19:20:58.572266 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.572248    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 19:20:58.572364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.572263    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 19:20:58.572364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.572264    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 06 19:20:58.572364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.572311    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 06 19:20:58.572594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.572578    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 19:20:58.572955 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.572941    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 06 19:20:58.585300 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.585278    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"]
Jul 06 19:20:58.588980 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.588962    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"]
Jul 06 19:20:58.612164 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.612131    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58d87b89cb-jlm2j"]
Jul 06 19:20:58.654889 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.654859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e22465-0658-4141-8be5-524d8d74d6f6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cg5xn\" (UID: \"79e22465-0658-4141-8be5-524d8d74d6f6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"
Jul 06 19:20:58.654889 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.654889    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.655070 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.654911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/79e22465-0658-4141-8be5-524d8d74d6f6-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cg5xn\" (UID: \"79e22465-0658-4141-8be5-524d8d74d6f6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"
Jul 06 19:20:58.655070 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.654942    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-hub\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.655070 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.654998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfz8h\" (UniqueName: \"kubernetes.io/projected/6f5e750b-b83b-46d4-8051-8e114d00eba4-kube-api-access-wfz8h\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.655070 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.655028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.655070 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.655058    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-ca\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.655231 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.655113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f5e750b-b83b-46d4-8051-8e114d00eba4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.661818 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.661794    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-4t4lr"]
Jul 06 19:20:58.663724 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.663691    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-4t4lr"
Jul 06 19:20:58.666287 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.666267    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xq68k\""
Jul 06 19:20:58.666405 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.666368    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 19:20:58.666895 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.666881    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 19:20:58.688203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.688180    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-4t4lr"]
Jul 06 19:20:58.694241 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.694194    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:58.755924 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.755889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfz8h\" (UniqueName: \"kubernetes.io/projected/6f5e750b-b83b-46d4-8051-8e114d00eba4-kube-api-access-wfz8h\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.755924 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.755925    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.756170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.755959    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-ca\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.756170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.755996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f5e750b-b83b-46d4-8051-8e114d00eba4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.756170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.756039    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e22465-0658-4141-8be5-524d8d74d6f6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cg5xn\" (UID: \"79e22465-0658-4141-8be5-524d8d74d6f6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"
Jul 06 19:20:58.756170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.756055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.756170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.756071    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/79e22465-0658-4141-8be5-524d8d74d6f6-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cg5xn\" (UID: \"79e22465-0658-4141-8be5-524d8d74d6f6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"
Jul 06 19:20:58.756416 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.756220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m7tm\" (UniqueName: \"kubernetes.io/projected/60b71e1f-756c-47b1-b29b-6dbb84f13586-kube-api-access-7m7tm\") pod \"downloads-685bfb5f64-4t4lr\" (UID: \"60b71e1f-756c-47b1-b29b-6dbb84f13586\") " pod="openshift-console/downloads-685bfb5f64-4t4lr"
Jul 06 19:20:58.756416 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.756282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-hub\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.756964 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.756937    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/79e22465-0658-4141-8be5-524d8d74d6f6-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-cg5xn\" (UID: \"79e22465-0658-4141-8be5-524d8d74d6f6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"
Jul 06 19:20:58.757156 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.757137    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f5e750b-b83b-46d4-8051-8e114d00eba4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.758625 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.758596    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-ca\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.759029 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.759007    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/79e22465-0658-4141-8be5-524d8d74d6f6-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-cg5xn\" (UID: \"79e22465-0658-4141-8be5-524d8d74d6f6\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"
Jul 06 19:20:58.759029 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.759017    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.759136 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.759078    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-hub\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.759199 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.759177    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6f5e750b-b83b-46d4-8051-8e114d00eba4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.777591 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.777563    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfz8h\" (UniqueName: \"kubernetes.io/projected/6f5e750b-b83b-46d4-8051-8e114d00eba4-kube-api-access-wfz8h\") pod \"cluster-proxy-proxy-agent-7c697db8d4-t5v85\" (UID: \"6f5e750b-b83b-46d4-8051-8e114d00eba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.794090 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.794067    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6497c8b9b8-qc6kp"]
Jul 06 19:20:58.796731 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.796699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.825997 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.825897    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6497c8b9b8-qc6kp"]
Jul 06 19:20:58.843089 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.843054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:58.857033 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.857013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c120f2f-36c5-42c7-84cd-4b257540da41-installation-pull-secrets\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.857146 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.857046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c120f2f-36c5-42c7-84cd-4b257540da41-image-registry-private-configuration\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.857146 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.857066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c120f2f-36c5-42c7-84cd-4b257540da41-bound-sa-token\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.857226 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.857142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c120f2f-36c5-42c7-84cd-4b257540da41-registry-certificates\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.857226 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.857167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c120f2f-36c5-42c7-84cd-4b257540da41-ca-trust-extracted\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.857226 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.857198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m7tm\" (UniqueName: \"kubernetes.io/projected/60b71e1f-756c-47b1-b29b-6dbb84f13586-kube-api-access-7m7tm\") pod \"downloads-685bfb5f64-4t4lr\" (UID: \"60b71e1f-756c-47b1-b29b-6dbb84f13586\") " pod="openshift-console/downloads-685bfb5f64-4t4lr"
Jul 06 19:20:58.857379 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.857296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c120f2f-36c5-42c7-84cd-4b257540da41-registry-tls\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.857379 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.857348    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c120f2f-36c5-42c7-84cd-4b257540da41-trusted-ca\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.857477 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.857458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmblc\" (UniqueName: \"kubernetes.io/projected/8c120f2f-36c5-42c7-84cd-4b257540da41-kube-api-access-kmblc\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.873011 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.872986    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"
Jul 06 19:20:58.876951 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.876932    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m7tm\" (UniqueName: \"kubernetes.io/projected/60b71e1f-756c-47b1-b29b-6dbb84f13586-kube-api-access-7m7tm\") pod \"downloads-685bfb5f64-4t4lr\" (UID: \"60b71e1f-756c-47b1-b29b-6dbb84f13586\") " pod="openshift-console/downloads-685bfb5f64-4t4lr"
Jul 06 19:20:58.895822 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.895795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"
Jul 06 19:20:58.959587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.958766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c120f2f-36c5-42c7-84cd-4b257540da41-image-registry-private-configuration\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.959587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.958823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c120f2f-36c5-42c7-84cd-4b257540da41-bound-sa-token\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.959587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.958876    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c120f2f-36c5-42c7-84cd-4b257540da41-registry-certificates\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.959587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.958905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c120f2f-36c5-42c7-84cd-4b257540da41-ca-trust-extracted\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.959587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.958936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c120f2f-36c5-42c7-84cd-4b257540da41-registry-tls\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.959587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.958979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c120f2f-36c5-42c7-84cd-4b257540da41-trusted-ca\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.959587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.959057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmblc\" (UniqueName: \"kubernetes.io/projected/8c120f2f-36c5-42c7-84cd-4b257540da41-kube-api-access-kmblc\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.959587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.959116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c120f2f-36c5-42c7-84cd-4b257540da41-installation-pull-secrets\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.960294 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.960269    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c120f2f-36c5-42c7-84cd-4b257540da41-registry-certificates\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.960572 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.960554    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c120f2f-36c5-42c7-84cd-4b257540da41-trusted-ca\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.960616 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.960563    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c120f2f-36c5-42c7-84cd-4b257540da41-ca-trust-extracted\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.962437 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.962410    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c120f2f-36c5-42c7-84cd-4b257540da41-installation-pull-secrets\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.962955 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.962936    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c120f2f-36c5-42c7-84cd-4b257540da41-registry-tls\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.963028 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.963011    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c120f2f-36c5-42c7-84cd-4b257540da41-image-registry-private-configuration\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.972640 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.972539    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-4t4lr"
Jul 06 19:20:58.972908 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.972863    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c120f2f-36c5-42c7-84cd-4b257540da41-bound-sa-token\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:58.973301 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:58.973256    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmblc\" (UniqueName: \"kubernetes.io/projected/8c120f2f-36c5-42c7-84cd-4b257540da41-kube-api-access-kmblc\") pod \"image-registry-6497c8b9b8-qc6kp\" (UID: \"8c120f2f-36c5-42c7-84cd-4b257540da41\") " pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:59.011581 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.011545    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn"]
Jul 06 19:20:59.014927 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:20:59.014888    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e22465_0658_4141_8be5_524d8d74d6f6.slice/crio-eced101440ff85d8207fd3545c2d3936252ef0ab51a628e54cbf9031f5818ebe WatchSource:0}: Error finding container eced101440ff85d8207fd3545c2d3936252ef0ab51a628e54cbf9031f5818ebe: Status 404 returned error can't find the container with id eced101440ff85d8207fd3545c2d3936252ef0ab51a628e54cbf9031f5818ebe
Jul 06 19:20:59.018377 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.018340    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:59.034420 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.034395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85"]
Jul 06 19:20:59.036501 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:20:59.036470    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f5e750b_b83b_46d4_8051_8e114d00eba4.slice/crio-a741e98d746a57883ff267dec78d00a83767a78fa9b61ce817392c96729784ac WatchSource:0}: Error finding container a741e98d746a57883ff267dec78d00a83767a78fa9b61ce817392c96729784ac: Status 404 returned error can't find the container with id a741e98d746a57883ff267dec78d00a83767a78fa9b61ce817392c96729784ac
Jul 06 19:20:59.105040 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.104803    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:59.106806 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.106728    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:59.106806 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.106784    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-4t4lr"]
Jul 06 19:20:59.110267 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:20:59.110244    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60b71e1f_756c_47b1_b29b_6dbb84f13586.slice/crio-a4dbacc1785d7a886cee7c3520c3dc8d3bbb3c4e4859c1e899d5a81252a24358 WatchSource:0}: Error finding container a4dbacc1785d7a886cee7c3520c3dc8d3bbb3c4e4859c1e899d5a81252a24358: Status 404 returned error can't find the container with id a4dbacc1785d7a886cee7c3520c3dc8d3bbb3c4e4859c1e899d5a81252a24358
Jul 06 19:20:59.198320 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.198261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:59.241245 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.241211    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6497c8b9b8-qc6kp"]
Jul 06 19:20:59.244101 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:20:59.244069    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c120f2f_36c5_42c7_84cd_4b257540da41.slice/crio-f86ccd33b75f434a7a7b96c380a040f2cad5ca7701468de56815d7e3190e24a0 WatchSource:0}: Error finding container f86ccd33b75f434a7a7b96c380a040f2cad5ca7701468de56815d7e3190e24a0: Status 404 returned error can't find the container with id f86ccd33b75f434a7a7b96c380a040f2cad5ca7701468de56815d7e3190e24a0
Jul 06 19:20:59.366755 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.366644    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp" event={"ID":"8c120f2f-36c5-42c7-84cd-4b257540da41","Type":"ContainerStarted","Data":"8b9edcc9296defec2b00ae9a1a4e136d3b1eb5580248060b6a05976775ba2fb5"}
Jul 06 19:20:59.366755 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.366715    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp" event={"ID":"8c120f2f-36c5-42c7-84cd-4b257540da41","Type":"ContainerStarted","Data":"f86ccd33b75f434a7a7b96c380a040f2cad5ca7701468de56815d7e3190e24a0"}
Jul 06 19:20:59.367258 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.366757    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:20:59.368098 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.368075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85" event={"ID":"6f5e750b-b83b-46d4-8051-8e114d00eba4","Type":"ContainerStarted","Data":"a741e98d746a57883ff267dec78d00a83767a78fa9b61ce817392c96729784ac"}
Jul 06 19:20:59.369253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.369234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-4t4lr" event={"ID":"60b71e1f-756c-47b1-b29b-6dbb84f13586","Type":"ContainerStarted","Data":"a4dbacc1785d7a886cee7c3520c3dc8d3bbb3c4e4859c1e899d5a81252a24358"}
Jul 06 19:20:59.370541 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.370521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn" event={"ID":"79e22465-0658-4141-8be5-524d8d74d6f6","Type":"ContainerStarted","Data":"eced101440ff85d8207fd3545c2d3936252ef0ab51a628e54cbf9031f5818ebe"}
Jul 06 19:20:59.389397 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.389356    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp" podStartSLOduration=1.389344688 podStartE2EDuration="1.389344688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:20:59.388607325 +0000 UTC m=+63.761089083" watchObservedRunningTime="2026-07-06 19:20:59.389344688 +0000 UTC m=+63.761826398"
Jul 06 19:20:59.613042 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.612939    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:20:59.702280 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:20:59.702200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:00.345569 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:00.344866    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pt8fk"
Jul 06 19:21:01.785659 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.785620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:21:01.787945 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.787918    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 19:21:01.801077 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.801001    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a0cc905-4958-4e00-afc0-8687189c0780-metrics-certs\") pod \"network-metrics-daemon-zmz58\" (UID: \"0a0cc905-4958-4e00-afc0-8687189c0780\") " pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:21:01.814542 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.814514    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-c88qg\""
Jul 06 19:21:01.822727 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.822662    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zmz58"
Jul 06 19:21:01.886611 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.886378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:21:01.889559 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.889249    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 19:21:01.900346 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.900315    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/23a01417-97d0-4c52-867c-dd9e9567ca4b-original-pull-secret\") pod \"global-pull-secret-syncer-sl8dp\" (UID: \"23a01417-97d0-4c52-867c-dd9e9567ca4b\") " pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:21:01.977565 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.977402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zmz58"]
Jul 06 19:21:01.987396 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.987366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lgb9\" (UniqueName: \"kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9\") pod \"network-check-target-pxm72\" (UID: \"5442c437-24f4-4cd3-9744-b687dc01e17c\") " pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:21:01.989905 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:01.989880    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 19:21:02.000165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:02.000135    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 19:21:02.010931 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:02.010876    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lgb9\" (UniqueName: \"kubernetes.io/projected/5442c437-24f4-4cd3-9744-b687dc01e17c-kube-api-access-8lgb9\") pod \"network-check-target-pxm72\" (UID: \"5442c437-24f4-4cd3-9744-b687dc01e17c\") " pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:21:02.106295 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:02.106264    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sl8dp"
Jul 06 19:21:02.120218 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:02.120018    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r9p6l\""
Jul 06 19:21:02.128260 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:02.128231    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:21:02.390088 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:02.390044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn" event={"ID":"79e22465-0658-4141-8be5-524d8d74d6f6","Type":"ContainerStarted","Data":"5354b095bedf81dee4d1ced7fab1c7a668d8799a47df3127b1a70c5a399ffb12"}
Jul 06 19:21:02.585513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:02.585474    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:02.656790 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:02.656560    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:03.231389 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:21:03.231352    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0cc905_4958_4e00_afc0_8687189c0780.slice/crio-33f07120ba37caed5ee108fa9cae1efcc32732cb97827ae2d75107c321b54557 WatchSource:0}: Error finding container 33f07120ba37caed5ee108fa9cae1efcc32732cb97827ae2d75107c321b54557: Status 404 returned error can't find the container with id 33f07120ba37caed5ee108fa9cae1efcc32732cb97827ae2d75107c321b54557
Jul 06 19:21:03.397485 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:03.397454    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zmz58" event={"ID":"0a0cc905-4958-4e00-afc0-8687189c0780","Type":"ContainerStarted","Data":"33f07120ba37caed5ee108fa9cae1efcc32732cb97827ae2d75107c321b54557"}
Jul 06 19:21:03.429137 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:03.429090    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-cg5xn" podStartSLOduration=3.694409894 podStartE2EDuration="5.429072287s" totalImagesPullingTime="1.734662393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:02.405844952 +0000 UTC m=+66.778326683" watchObservedRunningTime="2026-07-06 19:21:03.429072287 +0000 UTC m=+67.801554022"
Jul 06 19:21:03.430018 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:03.429993    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pxm72"]
Jul 06 19:21:03.431105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:03.431085    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sl8dp"]
Jul 06 19:21:03.433952 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:21:03.433927    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a01417_97d0_4c52_867c_dd9e9567ca4b.slice/crio-1c4a020dc1332317b567cdcb0749219ff2c63fcf98bb61ee570f346282131c88 WatchSource:0}: Error finding container 1c4a020dc1332317b567cdcb0749219ff2c63fcf98bb61ee570f346282131c88: Status 404 returned error can't find the container with id 1c4a020dc1332317b567cdcb0749219ff2c63fcf98bb61ee570f346282131c88
Jul 06 19:21:03.434225 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:21:03.434202    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5442c437_24f4_4cd3_9744_b687dc01e17c.slice/crio-49a09d341a9c1bc249be814d67a4dc3c2dcc767b2a9cca1f6b8f0f0cc9ba3856 WatchSource:0}: Error finding container 49a09d341a9c1bc249be814d67a4dc3c2dcc767b2a9cca1f6b8f0f0cc9ba3856: Status 404 returned error can't find the container with id 49a09d341a9c1bc249be814d67a4dc3c2dcc767b2a9cca1f6b8f0f0cc9ba3856
Jul 06 19:21:03.551999 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:03.551965    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:03.638545 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:03.638510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:04.403945 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:04.403904    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pxm72" event={"ID":"5442c437-24f4-4cd3-9744-b687dc01e17c","Type":"ContainerStarted","Data":"49a09d341a9c1bc249be814d67a4dc3c2dcc767b2a9cca1f6b8f0f0cc9ba3856"}
Jul 06 19:21:04.406786 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:04.406751    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85" event={"ID":"6f5e750b-b83b-46d4-8051-8e114d00eba4","Type":"ContainerStarted","Data":"cd63c4ec3608d603c1b9db98426aef4172afebc2d044648fe96acc0776550e18"}
Jul 06 19:21:04.406786 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:04.406797    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85" event={"ID":"6f5e750b-b83b-46d4-8051-8e114d00eba4","Type":"ContainerStarted","Data":"6f68022393e871c46bc67d3e215a7b2192c89480b680c739af300bfeae72b844"}
Jul 06 19:21:04.406970 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:04.406818    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85" event={"ID":"6f5e750b-b83b-46d4-8051-8e114d00eba4","Type":"ContainerStarted","Data":"367c506fd2fd42f8c24f8e886c5db05bcea7d95fe94c2969e2f0884deb1851fc"}
Jul 06 19:21:04.408436 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:04.408384    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sl8dp" event={"ID":"23a01417-97d0-4c52-867c-dd9e9567ca4b","Type":"ContainerStarted","Data":"1c4a020dc1332317b567cdcb0749219ff2c63fcf98bb61ee570f346282131c88"}
Jul 06 19:21:04.448207 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:04.448133    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c697db8d4-t5v85" podStartSLOduration=2.170649533 podStartE2EDuration="6.448111272s" totalImagesPullingTime="4.277461739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:04.445195674 +0000 UTC m=+68.817677434" watchObservedRunningTime="2026-07-06 19:21:04.448111272 +0000 UTC m=+68.820593006"
Jul 06 19:21:05.056421 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.056382    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:05.161081 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.160988    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:05.216802 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.216186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:21:05.228887 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.228819    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1918e148-d6fc-4023-9b40-e5de68ddea1c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wxdtr\" (UID: \"1918e148-d6fc-4023-9b40-e5de68ddea1c\") " pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:21:05.415836 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.415769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zmz58" event={"ID":"0a0cc905-4958-4e00-afc0-8687189c0780","Type":"ContainerStarted","Data":"53f2e3b029b0bb8ba246b1222a3de4039ffa15eae88390bff737645eaca1d49e"}
Jul 06 19:21:05.415836 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.415839    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zmz58" event={"ID":"0a0cc905-4958-4e00-afc0-8687189c0780","Type":"ContainerStarted","Data":"6d0d69d123a946f4c7e0a05dc660d029819aa03781c984549beadd4310f8c4fa"}
Jul 06 19:21:05.439942 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.439882    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zmz58" podStartSLOduration=68.015706586 podStartE2EDuration="1m9.439859039s" totalImagesPullingTime="1.424152453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:05.43819026 +0000 UTC m=+69.810672018" watchObservedRunningTime="2026-07-06 19:21:05.439859039 +0000 UTC m=+69.812340772"
Jul 06 19:21:05.476431 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.476319    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2lnlz\""
Jul 06 19:21:05.484718 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.484661    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wxdtr"
Jul 06 19:21:05.561155 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.561117    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:05.638834 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.638800    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:05.700939 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:05.700495    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wxdtr"]
Jul 06 19:21:06.252609 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:06.252559    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:06.343688 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:06.343601    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:06.423185 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:06.423110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxdtr" event={"ID":"1918e148-d6fc-4023-9b40-e5de68ddea1c","Type":"ContainerStarted","Data":"16a2e86f50d99dc750a9664a787cb75a5e00c2c0cd9718c962c45d46a878057b"}
Jul 06 19:21:06.813184 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:06.813147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:08.618897 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:08.618863    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:21:09.587514 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:09.587421    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:09.659419 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:09.659273    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:12.944343 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:12.944285    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:13.007099 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:13.007062    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:13.315217 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:13.315098    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:15.401687 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.401645    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:15.500321 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.500289    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:15.602636 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.602577    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:15.677143 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.677057    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vnh4n"]
Jul 06 19:21:15.687629 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.687598    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.690095 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.689821    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 19:21:15.692015 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.690542    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 19:21:15.692015 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.690912    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 19:21:15.692015 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.691109    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 19:21:15.692015 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.691290    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8s9tm\""
Jul 06 19:21:15.692015 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.691571    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 19:21:15.692349 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.692045    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 19:21:15.705259 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.705212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:15.798063 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.797960    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:15.821714 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.821659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64def843-4e84-4471-a054-8f3c73e20ce8-metrics-client-ca\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.821899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.821747    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.821899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.821793    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-accelerators-collector-config\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.821899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.821824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-wtmp\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.821899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.821886    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-textfile\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.822105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.821929    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64def843-4e84-4471-a054-8f3c73e20ce8-root\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.822105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.821955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64def843-4e84-4471-a054-8f3c73e20ce8-sys\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.822105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.821982    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-tls\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.822105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.822009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk925\" (UniqueName: \"kubernetes.io/projected/64def843-4e84-4471-a054-8f3c73e20ce8-kube-api-access-pk925\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.892132 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.892089    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:15.922829 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.922794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-textfile\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923014 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.922845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64def843-4e84-4471-a054-8f3c73e20ce8-root\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923014 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.922969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64def843-4e84-4471-a054-8f3c73e20ce8-sys\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923014 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.922997    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-tls\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923173 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.923015    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk925\" (UniqueName: \"kubernetes.io/projected/64def843-4e84-4471-a054-8f3c73e20ce8-kube-api-access-pk925\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923173 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.923080    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/64def843-4e84-4471-a054-8f3c73e20ce8-sys\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923173 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.923128    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/64def843-4e84-4471-a054-8f3c73e20ce8-root\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923173 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.923132    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64def843-4e84-4471-a054-8f3c73e20ce8-metrics-client-ca\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923396 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.923190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923396 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.923219    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-textfile\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923396 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.923224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-accelerators-collector-config\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923396 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.923285    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-wtmp\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923593 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.923440    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-wtmp\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.923690 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.923669    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64def843-4e84-4471-a054-8f3c73e20ce8-metrics-client-ca\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.924193 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.924171    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-accelerators-collector-config\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.926012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.925986    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-tls\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.926218 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.926200    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64def843-4e84-4471-a054-8f3c73e20ce8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.932693 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.932601    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk925\" (UniqueName: \"kubernetes.io/projected/64def843-4e84-4471-a054-8f3c73e20ce8-kube-api-access-pk925\") pod \"node-exporter-vnh4n\" (UID: \"64def843-4e84-4471-a054-8f3c73e20ce8\") " pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:15.993482 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:15.993439    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:16.001280 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:16.001249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vnh4n"
Jul 06 19:21:16.181572 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:16.181478    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:16.460464 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:16.460423    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:16.675040 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:16.674962    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:16.781625 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:16.781528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:16.988824 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:16.988777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:17.093623 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:17.093499    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:17.195437 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:17.195400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:17.264191 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:17.264154    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:18.664517 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:18.664482    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:18.743240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:18.742472    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:18.869761 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:18.869725    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:19.273369 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:19.273325    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:19.374974 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:19.374928    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:19.436298 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:19.436265    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:19.649579 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:21:19.649548    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64def843_4e84_4471_a054_8f3c73e20ce8.slice/crio-737d64a841da27e18f5eab1e8787ddfba3678b554ea737a909591fbd03541bdd WatchSource:0}: Error finding container 737d64a841da27e18f5eab1e8787ddfba3678b554ea737a909591fbd03541bdd: Status 404 returned error can't find the container with id 737d64a841da27e18f5eab1e8787ddfba3678b554ea737a909591fbd03541bdd
Jul 06 19:21:20.061694 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.061555    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:20.156946 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.156908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:20.386340 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.386275    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6497c8b9b8-qc6kp"
Jul 06 19:21:20.439697 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.439662    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:20.483560 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.481759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pxm72" event={"ID":"5442c437-24f4-4cd3-9744-b687dc01e17c","Type":"ContainerStarted","Data":"f0e896bfaadb08be0646c44f921f8e1dba5aacc81dcccee589d1ee02941e96b9"}
Jul 06 19:21:20.483560 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.482571    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:21:20.486910 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.486878    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnh4n" event={"ID":"64def843-4e84-4471-a054-8f3c73e20ce8","Type":"ContainerStarted","Data":"737d64a841da27e18f5eab1e8787ddfba3678b554ea737a909591fbd03541bdd"}
Jul 06 19:21:20.490325 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.490248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sl8dp" event={"ID":"23a01417-97d0-4c52-867c-dd9e9567ca4b","Type":"ContainerStarted","Data":"0cb18aa01e654a2267d183f5038a984f6bbed2191675e769335c0975ae541356"}
Jul 06 19:21:20.493539 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.493506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxdtr" event={"ID":"1918e148-d6fc-4023-9b40-e5de68ddea1c","Type":"ContainerStarted","Data":"bf2cb1c8c0cb585bbbe477d81e4baf36560f5b295f4b249ab468150ceb32349c"}
Jul 06 19:21:20.496258 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.496223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-4t4lr" event={"ID":"60b71e1f-756c-47b1-b29b-6dbb84f13586","Type":"ContainerStarted","Data":"c7ad27fdd13a449a986faab2724a102b9f0986d31dfdeb51de7a27653985bc4a"}
Jul 06 19:21:20.498846 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.498534    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-4t4lr"
Jul 06 19:21:20.509544 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.509492    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-4t4lr"
Jul 06 19:21:20.542383 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.542310    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pxm72" podStartSLOduration=68.918248023 podStartE2EDuration="1m24.542288109s" totalImagesPullingTime="15.624040086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:20.509127271 +0000 UTC m=+84.881609004" watchObservedRunningTime="2026-07-06 19:21:20.542288109 +0000 UTC m=+84.914769842"
Jul 06 19:21:20.546069 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.546035    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:20.559808 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.559561    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sl8dp" podStartSLOduration=68.349081399 podStartE2EDuration="1m24.559539035s" totalImagesPullingTime="16.210457636s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:20.541986751 +0000 UTC m=+84.914468483" watchObservedRunningTime="2026-07-06 19:21:20.559539035 +0000 UTC m=+84.932020744"
Jul 06 19:21:20.560481 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.560441    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-4t4lr" podStartSLOduration=1.9809387109999999 podStartE2EDuration="22.560430673s" totalImagesPullingTime="20.579491962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:20.55900266 +0000 UTC m=+84.931484394" watchObservedRunningTime="2026-07-06 19:21:20.560430673 +0000 UTC m=+84.932912405"
Jul 06 19:21:20.640301 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.640212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:20.745376 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.745335    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:20.843878 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:20.843793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:21.031855 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:21.031771    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:22.015170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:22.015082    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:22.133476 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:22.133429    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:22.232320 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:22.232287    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:22.342870 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:22.342772    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:22.508380 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:22.508333    2579 generic.go:356] "Generic (PLEG): container finished" podID="64def843-4e84-4471-a054-8f3c73e20ce8" containerID="0c7a732711753acdf49bf516951bba4280fd1f3a1ed3e9819d45f43d1f78a201" exitCode=0
Jul 06 19:21:22.508917 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:22.508451    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnh4n" event={"ID":"64def843-4e84-4471-a054-8f3c73e20ce8","Type":"ContainerDied","Data":"0c7a732711753acdf49bf516951bba4280fd1f3a1ed3e9819d45f43d1f78a201"}
Jul 06 19:21:22.511520 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:22.511492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxdtr" event={"ID":"1918e148-d6fc-4023-9b40-e5de68ddea1c","Type":"ContainerStarted","Data":"49d6ab2c1991087523a671b8e635a0658e31e2977fbb398420a2214160045036"}
Jul 06 19:21:23.524746 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:23.524631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnh4n" event={"ID":"64def843-4e84-4471-a054-8f3c73e20ce8","Type":"ContainerStarted","Data":"da17374718ef098136c08e4aef50edc084f393b8a9f7af951665a29cae3aec4d"}
Jul 06 19:21:23.525282 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:23.525254    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnh4n" event={"ID":"64def843-4e84-4471-a054-8f3c73e20ce8","Type":"ContainerStarted","Data":"093a4b206e25b8d2b2ac554563d14367a54d15f062c908c3e46875897f674041"}
Jul 06 19:21:23.548624 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:23.548534    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vnh4n" podStartSLOduration=6.688465024 podStartE2EDuration="8.548516847s" totalImagesPullingTime="1.755050782s" totalInitContainerRuntime="105.001041ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:23.546963016 +0000 UTC m=+87.919444766" watchObservedRunningTime="2026-07-06 19:21:23.548516847 +0000 UTC m=+87.920998619"
Jul 06 19:21:23.632393 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:23.632347    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j" podUID="fff503cd-910d-45f9-b7d2-97301c65179a" containerName="registry" containerID="cri-o://ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd" gracePeriod=30
Jul 06 19:21:24.864749 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.864717    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:21:24.899802 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.899762    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-registry-certificates\") pod \"fff503cd-910d-45f9-b7d2-97301c65179a\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") "
Jul 06 19:21:24.899802 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.899808    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-installation-pull-secrets\") pod \"fff503cd-910d-45f9-b7d2-97301c65179a\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") "
Jul 06 19:21:24.900062 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.899863    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fff503cd-910d-45f9-b7d2-97301c65179a-ca-trust-extracted\") pod \"fff503cd-910d-45f9-b7d2-97301c65179a\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") "
Jul 06 19:21:24.900062 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.899892    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-trusted-ca\") pod \"fff503cd-910d-45f9-b7d2-97301c65179a\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") "
Jul 06 19:21:24.900062 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.899918    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-bound-sa-token\") pod \"fff503cd-910d-45f9-b7d2-97301c65179a\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") "
Jul 06 19:21:24.900062 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.899943    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls\") pod \"fff503cd-910d-45f9-b7d2-97301c65179a\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") "
Jul 06 19:21:24.900062 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.900054    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57rjc\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-kube-api-access-57rjc\") pod \"fff503cd-910d-45f9-b7d2-97301c65179a\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") "
Jul 06 19:21:24.900315 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.900180    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fff503cd-910d-45f9-b7d2-97301c65179a" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:21:24.900315 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.900292    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-registry-certificates\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:21:24.900419 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.900340    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fff503cd-910d-45f9-b7d2-97301c65179a" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:21:24.903189 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.903138    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fff503cd-910d-45f9-b7d2-97301c65179a" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:21:24.903741 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.903698    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fff503cd-910d-45f9-b7d2-97301c65179a" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:21:24.907140 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.907112    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-kube-api-access-57rjc" (OuterVolumeSpecName: "kube-api-access-57rjc") pod "fff503cd-910d-45f9-b7d2-97301c65179a" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a"). InnerVolumeSpecName "kube-api-access-57rjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:21:24.909002 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.908690    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fff503cd-910d-45f9-b7d2-97301c65179a" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:21:24.911324 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:24.911300    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fff503cd-910d-45f9-b7d2-97301c65179a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fff503cd-910d-45f9-b7d2-97301c65179a" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:21:25.001186 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.001149    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-image-registry-private-configuration\") pod \"fff503cd-910d-45f9-b7d2-97301c65179a\" (UID: \"fff503cd-910d-45f9-b7d2-97301c65179a\") "
Jul 06 19:21:25.001373 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.001353    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fff503cd-910d-45f9-b7d2-97301c65179a-ca-trust-extracted\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:21:25.001373 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.001370    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fff503cd-910d-45f9-b7d2-97301c65179a-trusted-ca\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:21:25.001480 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.001383    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-bound-sa-token\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:21:25.001480 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.001395    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-registry-tls\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:21:25.001480 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.001407    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57rjc\" (UniqueName: \"kubernetes.io/projected/fff503cd-910d-45f9-b7d2-97301c65179a-kube-api-access-57rjc\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:21:25.001480 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.001420    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-installation-pull-secrets\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:21:25.003642 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.003609    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fff503cd-910d-45f9-b7d2-97301c65179a" (UID: "fff503cd-910d-45f9-b7d2-97301c65179a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:21:25.102173 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.102141    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fff503cd-910d-45f9-b7d2-97301c65179a-image-registry-private-configuration\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:21:25.161169 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.161137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:25.255951 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.255869    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:25.538974 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.538878    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wxdtr" event={"ID":"1918e148-d6fc-4023-9b40-e5de68ddea1c","Type":"ContainerStarted","Data":"52c3c222e5366c1c24f8cf2a7a89f068eeac04d75d77a348044b8e557d7ddcca"}
Jul 06 19:21:25.540412 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.540378    2579 generic.go:356] "Generic (PLEG): container finished" podID="fff503cd-910d-45f9-b7d2-97301c65179a" containerID="ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd" exitCode=0
Jul 06 19:21:25.540570 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.540442    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j"
Jul 06 19:21:25.540570 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.540441    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j" event={"ID":"fff503cd-910d-45f9-b7d2-97301c65179a","Type":"ContainerDied","Data":"ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd"}
Jul 06 19:21:25.540570 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.540541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58d87b89cb-jlm2j" event={"ID":"fff503cd-910d-45f9-b7d2-97301c65179a","Type":"ContainerDied","Data":"24b69421c7f10a1f7f21b899e360a9bd8c90e9fcd762734a5676978428e9b633"}
Jul 06 19:21:25.540751 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.540584    2579 scope.go:117] "RemoveContainer" containerID="ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd"
Jul 06 19:21:25.563093 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.563064    2579 scope.go:117] "RemoveContainer" containerID="ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd"
Jul 06 19:21:25.563478 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.563434    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wxdtr" podStartSLOduration=33.431217176 podStartE2EDuration="52.563416268s" totalImagesPullingTime="19.132199092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:20:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:21:25.562245807 +0000 UTC m=+89.934727565" watchObservedRunningTime="2026-07-06 19:21:25.563416268 +0000 UTC m=+89.935898014"
Jul 06 19:21:25.563600 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:21:25.563485    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd\": container with ID starting with ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd not found: ID does not exist" containerID="ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd"
Jul 06 19:21:25.563600 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.563527    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd"} err="failed to get container status \"ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd\": rpc error: code = NotFound desc = could not find container \"ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd\": container with ID starting with ca6468c3b48546fb67cd23b15d3098ba49aa7347102361f67daef3dd136ff0dd not found: ID does not exist"
Jul 06 19:21:25.581392 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.581345    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58d87b89cb-jlm2j"]
Jul 06 19:21:25.588866 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:25.588837    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58d87b89cb-jlm2j"]
Jul 06 19:21:26.099304 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:26.099272    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fff503cd-910d-45f9-b7d2-97301c65179a" path="/var/lib/kubelet/pods/fff503cd-910d-45f9-b7d2-97301c65179a/volumes"
Jul 06 19:21:26.197889 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:26.197859    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:26.299182 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:26.299144    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:26.708968 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:26.708930    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:26.821180 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:26.821146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:26.924220 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:26.924176    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:27.764893 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:27.764843    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:28.360207 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:28.360169    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:28.464503 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:28.464465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:29.345487 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:29.345439    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:29.405057 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:29.405015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:31.093759 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:31.093727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:31.196246 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:31.196202    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:33.021716 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:33.021667    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:34.372382 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:34.372351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:34.470250 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:34.470212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:35.073785 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:35.073756    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:35.163015 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:35.162965    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:50.056339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:50.056301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:50.128027 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:50.127986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:51.492999 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:51.492966    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:51.560636 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:51.560608    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:52.514433 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:52.514400    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pxm72"
Jul 06 19:21:58.282270 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:58.282238    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:21:58.394003 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:21:58.393957    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:22:34.994718 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:22:34.994662    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:22:35.227292 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:22:35.227259    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:22:44.300083 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:22:44.300040    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:22:44.387678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:22:44.387646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:22:44.487989 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:22:44.487956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:22:45.030347 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:22:45.030313    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:22:45.110695 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:22:45.110656    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:22:55.744182 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:22:55.744104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:22:55.845886 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:22:55.845838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:23.950010 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:23:23.949970    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:24.050437 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:23:24.050404    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:50.286743 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:23:50.286695    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:50.386166 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:23:50.386127    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:51.361818 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:23:51.361785    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:23:51.428384 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:23:51.428354    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:01.912461 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:01.912424    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:02.012803 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:02.012768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:02.073617 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:02.073588    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:02.302663 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:02.302581    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:02.403798 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:02.403770    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:05.053018 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:05.052978    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:05.158160 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:05.158124    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:29.489335 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:29.489247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:29.586178 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:29.586138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:55.964605 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:55.964579    2579 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 19:24:56.772788 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:56.772747    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:24:58.161350 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:24:58.161314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:00.581919 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:00.581883    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:00.681302 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:00.681271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:01.921676 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:01.921639    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:02.022357 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:02.022327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:02.661456 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:02.661425    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:02.884336 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:02.884302    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:04.170176 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:04.170138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:04.574492 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:04.574400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:07.623172 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:07.623125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:07.704399 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:07.704361    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:11.009789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:11.009752    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:11.115401 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:11.115362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:12.705225 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.705196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:12.853631 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.853599    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kbmgb"]
Jul 06 19:25:12.853850 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.853839    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fff503cd-910d-45f9-b7d2-97301c65179a" containerName="registry"
Jul 06 19:25:12.853895 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.853851    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fff503cd-910d-45f9-b7d2-97301c65179a" containerName="registry"
Jul 06 19:25:12.858205 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.854423    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fff503cd-910d-45f9-b7d2-97301c65179a" containerName="registry"
Jul 06 19:25:12.859411 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.859394    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kbmgb"
Jul 06 19:25:12.861740 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.861719    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 06 19:25:12.861841 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.861721    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 06 19:25:12.862538 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.862524    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hqd5p\""
Jul 06 19:25:12.867263 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.867238    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kbmgb"]
Jul 06 19:25:12.966088 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.966004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/324fc538-c8ce-499f-9052-f57fbfd66e1c-bound-sa-token\") pod \"cert-manager-55b4d954d5-kbmgb\" (UID: \"324fc538-c8ce-499f-9052-f57fbfd66e1c\") " pod="cert-manager/cert-manager-55b4d954d5-kbmgb"
Jul 06 19:25:12.966088 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:12.966047    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqmrw\" (UniqueName: \"kubernetes.io/projected/324fc538-c8ce-499f-9052-f57fbfd66e1c-kube-api-access-hqmrw\") pod \"cert-manager-55b4d954d5-kbmgb\" (UID: \"324fc538-c8ce-499f-9052-f57fbfd66e1c\") " pod="cert-manager/cert-manager-55b4d954d5-kbmgb"
Jul 06 19:25:13.067260 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:13.067227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/324fc538-c8ce-499f-9052-f57fbfd66e1c-bound-sa-token\") pod \"cert-manager-55b4d954d5-kbmgb\" (UID: \"324fc538-c8ce-499f-9052-f57fbfd66e1c\") " pod="cert-manager/cert-manager-55b4d954d5-kbmgb"
Jul 06 19:25:13.067422 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:13.067275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqmrw\" (UniqueName: \"kubernetes.io/projected/324fc538-c8ce-499f-9052-f57fbfd66e1c-kube-api-access-hqmrw\") pod \"cert-manager-55b4d954d5-kbmgb\" (UID: \"324fc538-c8ce-499f-9052-f57fbfd66e1c\") " pod="cert-manager/cert-manager-55b4d954d5-kbmgb"
Jul 06 19:25:13.079807 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:13.079776    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqmrw\" (UniqueName: \"kubernetes.io/projected/324fc538-c8ce-499f-9052-f57fbfd66e1c-kube-api-access-hqmrw\") pod \"cert-manager-55b4d954d5-kbmgb\" (UID: \"324fc538-c8ce-499f-9052-f57fbfd66e1c\") " pod="cert-manager/cert-manager-55b4d954d5-kbmgb"
Jul 06 19:25:13.080770 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:13.080753    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/324fc538-c8ce-499f-9052-f57fbfd66e1c-bound-sa-token\") pod \"cert-manager-55b4d954d5-kbmgb\" (UID: \"324fc538-c8ce-499f-9052-f57fbfd66e1c\") " pod="cert-manager/cert-manager-55b4d954d5-kbmgb"
Jul 06 19:25:13.168540 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:13.168508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-kbmgb"
Jul 06 19:25:13.295849 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:13.295817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-kbmgb"]
Jul 06 19:25:13.298846 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:25:13.298819    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod324fc538_c8ce_499f_9052_f57fbfd66e1c.slice/crio-e25668f3cf5a1aba72b3f650858abfed6a03b64443c883303473b1c5cd85cc2c WatchSource:0}: Error finding container e25668f3cf5a1aba72b3f650858abfed6a03b64443c883303473b1c5cd85cc2c: Status 404 returned error can't find the container with id e25668f3cf5a1aba72b3f650858abfed6a03b64443c883303473b1c5cd85cc2c
Jul 06 19:25:13.301207 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:13.301191    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:25:14.284338 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:14.284297    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kbmgb" event={"ID":"324fc538-c8ce-499f-9052-f57fbfd66e1c","Type":"ContainerStarted","Data":"e25668f3cf5a1aba72b3f650858abfed6a03b64443c883303473b1c5cd85cc2c"}
Jul 06 19:25:17.296896 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:17.296866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-kbmgb" event={"ID":"324fc538-c8ce-499f-9052-f57fbfd66e1c","Type":"ContainerStarted","Data":"c0c813c22ac3090816051740364044485b4b864c9cdd7215373f788947b79b1f"}
Jul 06 19:25:17.335092 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:17.335038    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-kbmgb" podStartSLOduration=2.04841937 podStartE2EDuration="5.335020711s" totalImagesPullingTime="3.286601341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:17.334405931 +0000 UTC m=+321.706887686" watchObservedRunningTime="2026-07-06 19:25:17.335020711 +0000 UTC m=+321.707502442"
Jul 06 19:25:17.976088 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:17.976053    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:18.095824 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:18.095773    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:19.034179 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:19.034144    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:19.153046 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:19.153013    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:19.778162 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:19.778113    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:31.877501 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:31.877453    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:32.047223 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:32.047191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:32.341395 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:32.341294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:32.867397 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:32.867359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:32.997415 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:32.997381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:33.058645 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.058611    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"]
Jul 06 19:25:33.065036 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.065014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.069587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.069554    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 19:25:33.069587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.069554    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 19:25:33.069587 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.069584    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 19:25:33.069821 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.069573    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 19:25:33.069821 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.069576    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tfnth\""
Jul 06 19:25:33.086374 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.086345    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"]
Jul 06 19:25:33.108972 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.108941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c4f5dff-14f1-4911-aa17-db2d32856d4d-webhook-cert\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.109128 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.109013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c4f5dff-14f1-4911-aa17-db2d32856d4d-manifests\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.109128 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.109084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4f5dff-14f1-4911-aa17-db2d32856d4d-tmp\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.109128 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.109116    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lb79p\" (UniqueName: \"kubernetes.io/projected/9c4f5dff-14f1-4911-aa17-db2d32856d4d-kube-api-access-lb79p\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.109253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.109136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c4f5dff-14f1-4911-aa17-db2d32856d4d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.210104 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.210018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lb79p\" (UniqueName: \"kubernetes.io/projected/9c4f5dff-14f1-4911-aa17-db2d32856d4d-kube-api-access-lb79p\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.210104 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.210055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c4f5dff-14f1-4911-aa17-db2d32856d4d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.210104 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.210090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c4f5dff-14f1-4911-aa17-db2d32856d4d-webhook-cert\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.210384 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.210123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c4f5dff-14f1-4911-aa17-db2d32856d4d-manifests\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.210384 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.210154    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4f5dff-14f1-4911-aa17-db2d32856d4d-tmp\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.210776 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.210756    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c4f5dff-14f1-4911-aa17-db2d32856d4d-manifests\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.212552 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.212527    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4f5dff-14f1-4911-aa17-db2d32856d4d-tmp\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.212802 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.212784    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c4f5dff-14f1-4911-aa17-db2d32856d4d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.212870 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.212854    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c4f5dff-14f1-4911-aa17-db2d32856d4d-webhook-cert\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.238314 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.238277    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lb79p\" (UniqueName: \"kubernetes.io/projected/9c4f5dff-14f1-4911-aa17-db2d32856d4d-kube-api-access-lb79p\") pod \"opendatahub-operator-controller-manager-69fd78d8d5-xp6g4\" (UID: \"9c4f5dff-14f1-4911-aa17-db2d32856d4d\") " pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.295089 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.295054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:33.374899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.374869    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:33.417469 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.417429    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:33.514332 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.514305    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"]
Jul 06 19:25:33.516965 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:25:33.516941    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4f5dff_14f1_4911_aa17_db2d32856d4d.slice/crio-5ef307687089888debb7fff3de8c4d21b4f51041e186c9fc11cd86c440d82224 WatchSource:0}: Error finding container 5ef307687089888debb7fff3de8c4d21b4f51041e186c9fc11cd86c440d82224: Status 404 returned error can't find the container with id 5ef307687089888debb7fff3de8c4d21b4f51041e186c9fc11cd86c440d82224
Jul 06 19:25:33.529096 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.529068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:33.632423 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.632381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:33.740306 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.740278    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:33.846990 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:33.846885    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:34.355175 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:34.355135    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4" event={"ID":"9c4f5dff-14f1-4911-aa17-db2d32856d4d","Type":"ContainerStarted","Data":"5ef307687089888debb7fff3de8c4d21b4f51041e186c9fc11cd86c440d82224"}
Jul 06 19:25:37.368580 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:37.368537    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4" event={"ID":"9c4f5dff-14f1-4911-aa17-db2d32856d4d","Type":"ContainerStarted","Data":"19e176bf708ae914a63391e4de969f54c45d2004faf5af153be7776cee507f8c"}
Jul 06 19:25:38.179544 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:38.179458    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:38.373171 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:38.373140    2579 generic.go:356] "Generic (PLEG): container finished" podID="9c4f5dff-14f1-4911-aa17-db2d32856d4d" containerID="19e176bf708ae914a63391e4de969f54c45d2004faf5af153be7776cee507f8c" exitCode=0
Jul 06 19:25:38.373594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:38.373228    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4" event={"ID":"9c4f5dff-14f1-4911-aa17-db2d32856d4d","Type":"ContainerDied","Data":"19e176bf708ae914a63391e4de969f54c45d2004faf5af153be7776cee507f8c"}
Jul 06 19:25:38.382367 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:38.382344    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:39.378354 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:39.378314    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4" event={"ID":"9c4f5dff-14f1-4911-aa17-db2d32856d4d","Type":"ContainerStarted","Data":"4b23d58dbf694c64cb685cedb689333e03fec8bc7b7f055d6557780a44d8a319"}
Jul 06 19:25:39.378787 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:39.378404    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:39.403990 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:39.403940    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4" podStartSLOduration=1.823253867 podStartE2EDuration="6.403924186s" totalImagesPullingTime="3.512176931s" totalInitContainerRuntime="1.068493388s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:39.402400475 +0000 UTC m=+343.774882218" watchObservedRunningTime="2026-07-06 19:25:39.403924186 +0000 UTC m=+343.776405917"
Jul 06 19:25:42.592150 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:42.592116    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:50.384638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:50.384437    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69fd78d8d5-xp6g4"
Jul 06 19:25:52.768299 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:52.768264    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:53.024411 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.024327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:53.558067 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.558034    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"]
Jul 06 19:25:53.558365 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.558341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:53.561260 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.561244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:53.566768 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.566736    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:25:53.567196 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.567170    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 19:25:53.567314 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.567175    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 19:25:53.567845 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.567825    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 19:25:53.603381 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.603348    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"]
Jul 06 19:25:53.655642 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.655607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kmws\" (UniqueName: \"kubernetes.io/projected/381d400d-5ca7-41c0-8485-40c3c862a606-kube-api-access-6kmws\") pod \"kube-auth-proxy-7bc75879f5-2skj2\" (UID: \"381d400d-5ca7-41c0-8485-40c3c862a606\") " pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:53.655834 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.655650    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/381d400d-5ca7-41c0-8485-40c3c862a606-tmp\") pod \"kube-auth-proxy-7bc75879f5-2skj2\" (UID: \"381d400d-5ca7-41c0-8485-40c3c862a606\") " pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:53.655834 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.655671    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381d400d-5ca7-41c0-8485-40c3c862a606-tls-certs\") pod \"kube-auth-proxy-7bc75879f5-2skj2\" (UID: \"381d400d-5ca7-41c0-8485-40c3c862a606\") " pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:53.757027 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.756993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kmws\" (UniqueName: \"kubernetes.io/projected/381d400d-5ca7-41c0-8485-40c3c862a606-kube-api-access-6kmws\") pod \"kube-auth-proxy-7bc75879f5-2skj2\" (UID: \"381d400d-5ca7-41c0-8485-40c3c862a606\") " pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:53.757027 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.757034    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/381d400d-5ca7-41c0-8485-40c3c862a606-tmp\") pod \"kube-auth-proxy-7bc75879f5-2skj2\" (UID: \"381d400d-5ca7-41c0-8485-40c3c862a606\") " pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:53.757288 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.757057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381d400d-5ca7-41c0-8485-40c3c862a606-tls-certs\") pod \"kube-auth-proxy-7bc75879f5-2skj2\" (UID: \"381d400d-5ca7-41c0-8485-40c3c862a606\") " pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:53.759357 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.759330    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/381d400d-5ca7-41c0-8485-40c3c862a606-tmp\") pod \"kube-auth-proxy-7bc75879f5-2skj2\" (UID: \"381d400d-5ca7-41c0-8485-40c3c862a606\") " pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:53.759682 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.759661    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/381d400d-5ca7-41c0-8485-40c3c862a606-tls-certs\") pod \"kube-auth-proxy-7bc75879f5-2skj2\" (UID: \"381d400d-5ca7-41c0-8485-40c3c862a606\") " pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:53.773014 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.772988    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kmws\" (UniqueName: \"kubernetes.io/projected/381d400d-5ca7-41c0-8485-40c3c862a606-kube-api-access-6kmws\") pod \"kube-auth-proxy-7bc75879f5-2skj2\" (UID: \"381d400d-5ca7-41c0-8485-40c3c862a606\") " pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:53.838169 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.838058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:53.870236 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:53.870206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"
Jul 06 19:25:54.010441 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:54.010408    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:54.027224 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:54.027198    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2"]
Jul 06 19:25:54.030404 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:25:54.030378    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381d400d_5ca7_41c0_8485_40c3c862a606.slice/crio-0bd26b8de274a44ff3354c5d954bf68b0573a1801f94211a934dd6c87de78d17 WatchSource:0}: Error finding container 0bd26b8de274a44ff3354c5d954bf68b0573a1801f94211a934dd6c87de78d17: Status 404 returned error can't find the container with id 0bd26b8de274a44ff3354c5d954bf68b0573a1801f94211a934dd6c87de78d17
Jul 06 19:25:54.095991 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:54.095874    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:54.434940 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:54.434902    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2" event={"ID":"381d400d-5ca7-41c0-8485-40c3c862a606","Type":"ContainerStarted","Data":"0bd26b8de274a44ff3354c5d954bf68b0573a1801f94211a934dd6c87de78d17"}
Jul 06 19:25:54.714334 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:54.714250    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:54.859345 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:54.859180    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:54.987276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:54.987184    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:55.309191 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:55.309098    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:55.395097 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:55.395062    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:56.428933 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:56.428899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:25:57.205955 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:57.205920    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 19:25:57.446578 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:57.446535    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2" event={"ID":"381d400d-5ca7-41c0-8485-40c3c862a606","Type":"ContainerStarted","Data":"50525515741c8b60a7723d2930d178726759f8dbc8dda40ef5ff78e48b0468d8"}
Jul 06 19:25:57.467496 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:25:57.467403    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bc75879f5-2skj2" podStartSLOduration=1.296018196 podStartE2EDuration="4.467388627s" totalImagesPullingTime="3.171370431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:25:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:25:57.466080951 +0000 UTC m=+361.838562682" watchObservedRunningTime="2026-07-06 19:25:57.467388627 +0000 UTC m=+361.839870359"
Jul 06 19:26:01.878293 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:01.878250    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:02.128114 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.128082    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:02.356430 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.356403    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"]
Jul 06 19:26:02.359623 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.359608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.367811 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.367790    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cd77j\""
Jul 06 19:26:02.368040 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.368027    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 06 19:26:02.379670 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.379633    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:02.402265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.402238    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"]
Jul 06 19:26:02.423990 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.423955    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.424131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.424006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/147d9857-131c-4000-8826-de067cae9f8a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.424131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.424075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/147d9857-131c-4000-8826-de067cae9f8a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.424207 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.424131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4xlk\" (UniqueName: \"kubernetes.io/projected/147d9857-131c-4000-8826-de067cae9f8a-kube-api-access-h4xlk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.424207 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.424154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.424207 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.424170    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.424207 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.424201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.424318 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.424290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.424352 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.424321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/147d9857-131c-4000-8826-de067cae9f8a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.525511 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.525477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.525681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.525533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/147d9857-131c-4000-8826-de067cae9f8a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.525681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.525561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/147d9857-131c-4000-8826-de067cae9f8a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.525681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.525587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4xlk\" (UniqueName: \"kubernetes.io/projected/147d9857-131c-4000-8826-de067cae9f8a-kube-api-access-h4xlk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.525847 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.525739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.525847 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.525760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.525847 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.525784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.525847 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.525823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.526044 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.525851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/147d9857-131c-4000-8826-de067cae9f8a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.526133 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.526104    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.526263 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.526237    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.526317 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.526273    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.526363 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.526348    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.526491 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.526468    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/147d9857-131c-4000-8826-de067cae9f8a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.527811 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.527787    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/147d9857-131c-4000-8826-de067cae9f8a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.528033 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.528014    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/147d9857-131c-4000-8826-de067cae9f8a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.538237 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.538166    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:02.542824 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.542801    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/147d9857-131c-4000-8826-de067cae9f8a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.542984 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.542965    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4xlk\" (UniqueName: \"kubernetes.io/projected/147d9857-131c-4000-8826-de067cae9f8a-kube-api-access-h4xlk\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4xskmt\" (UID: \"147d9857-131c-4000-8826-de067cae9f8a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.637825 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.637741    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:02.669939 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.669902    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:02.813007 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:02.812977    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"]
Jul 06 19:26:02.815415 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:26:02.815385    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod147d9857_131c_4000_8826_de067cae9f8a.slice/crio-67e21d08f8f087d77248bbb2b776b03d801572ec5cc27ec39f5e199691dbbd97 WatchSource:0}: Error finding container 67e21d08f8f087d77248bbb2b776b03d801572ec5cc27ec39f5e199691dbbd97: Status 404 returned error can't find the container with id 67e21d08f8f087d77248bbb2b776b03d801572ec5cc27ec39f5e199691dbbd97
Jul 06 19:26:03.005771 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.005675    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"]
Jul 06 19:26:03.009903 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.009885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.013176 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.013152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8m96c\""
Jul 06 19:26:03.013176 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.013173    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 06 19:26:03.013369 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.013248    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 06 19:26:03.014076 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.014060    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 06 19:26:03.113550 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.113519    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"]
Jul 06 19:26:03.131074 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.131046    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4626c5a2-2078-4afd-9ddd-373dd061d588-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.131220 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.131092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.131220 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.131125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4626c5a2-2078-4afd-9ddd-373dd061d588-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.131220 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.131163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.131321 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.131245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.131321 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.131269    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx25d\" (UniqueName: \"kubernetes.io/projected/4626c5a2-2078-4afd-9ddd-373dd061d588-kube-api-access-bx25d\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.131321 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.131292    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.232379 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.232343    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.232379 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.232383    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.232621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.232402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx25d\" (UniqueName: \"kubernetes.io/projected/4626c5a2-2078-4afd-9ddd-373dd061d588-kube-api-access-bx25d\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.232621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.232418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.232621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.232444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4626c5a2-2078-4afd-9ddd-373dd061d588-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.232621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.232476    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.232621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.232527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4626c5a2-2078-4afd-9ddd-373dd061d588-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.233280 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.233210    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.234915 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.234885    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.235026 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.234917    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4626c5a2-2078-4afd-9ddd-373dd061d588-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.235026 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.234919    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4626c5a2-2078-4afd-9ddd-373dd061d588-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.235026 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.234956    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.241692 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.241672    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4626c5a2-2078-4afd-9ddd-373dd061d588-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.244059 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.244041    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx25d\" (UniqueName: \"kubernetes.io/projected/4626c5a2-2078-4afd-9ddd-373dd061d588-kube-api-access-bx25d\") pod \"istiod-openshift-gateway-94bb8fbfd-w8qlb\" (UID: \"4626c5a2-2078-4afd-9ddd-373dd061d588\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.319012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.318926    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:03.469771 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.469739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt" event={"ID":"147d9857-131c-4000-8826-de067cae9f8a","Type":"ContainerStarted","Data":"67e21d08f8f087d77248bbb2b776b03d801572ec5cc27ec39f5e199691dbbd97"}
Jul 06 19:26:03.472398 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:03.472372    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"]
Jul 06 19:26:03.472521 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:26:03.472503    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4626c5a2_2078_4afd_9ddd_373dd061d588.slice/crio-096e61e5f743ea7a40fe6b8ce2bb22c86107b7682d756caa823d110750a46f33 WatchSource:0}: Error finding container 096e61e5f743ea7a40fe6b8ce2bb22c86107b7682d756caa823d110750a46f33: Status 404 returned error can't find the container with id 096e61e5f743ea7a40fe6b8ce2bb22c86107b7682d756caa823d110750a46f33
Jul 06 19:26:04.476642 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:04.476591    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb" event={"ID":"4626c5a2-2078-4afd-9ddd-373dd061d588","Type":"ContainerStarted","Data":"096e61e5f743ea7a40fe6b8ce2bb22c86107b7682d756caa823d110750a46f33"}
Jul 06 19:26:06.343646 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:06.343602    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:06.467240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:06.467189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:06.555733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:06.555657    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:06.723219 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:06.723171    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:06.847133 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:06.847077    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:06.948289 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:06.948252    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:06.969134 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:06.969093    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:26:06.969235 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:06.969173    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:26:07.022657 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:07.022625    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:26:07.022845 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:07.022691    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:26:07.022845 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:07.022755    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:26:07.190943 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:07.190908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:07.490756 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:07.490681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt" event={"ID":"147d9857-131c-4000-8826-de067cae9f8a","Type":"ContainerStarted","Data":"feb9ccf595c0b43c728bbc5c8f013cc4eca97a8a8ed8a920d310a7778ae7460d"}
Jul 06 19:26:07.492214 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:07.492191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb" event={"ID":"4626c5a2-2078-4afd-9ddd-373dd061d588","Type":"ContainerStarted","Data":"1a8620025afb2df178fc88df9264a42434512ff1623eef8aaf84e65574dafc01"}
Jul 06 19:26:07.492350 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:07.492310    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:07.545495 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:07.545444    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt" podStartSLOduration=1.340326257 podStartE2EDuration="5.545428737s" totalImagesPullingTime="4.20510248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:07.544438206 +0000 UTC m=+371.916919938" watchObservedRunningTime="2026-07-06 19:26:07.545428737 +0000 UTC m=+371.917910468"
Jul 06 19:26:07.580944 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:07.580892    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb" podStartSLOduration=2.08642161 podStartE2EDuration="5.580873892s" totalImagesPullingTime="3.494452282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:26:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:26:07.578470401 +0000 UTC m=+371.950952148" watchObservedRunningTime="2026-07-06 19:26:07.580873892 +0000 UTC m=+371.953355623"
Jul 06 19:26:07.670982 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:07.670951    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:08.498015 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:08.497992    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-w8qlb"
Jul 06 19:26:08.675726 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:08.675456    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:09.500085 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:09.500052    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:09.501064 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:09.501044    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4xskmt"
Jul 06 19:26:22.239674 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:22.239632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:22.521363 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:22.521280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:22.581235 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:22.581202    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:30.166852 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:30.166811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:30.230918 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:30.230884    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:32.019421 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:32.019383    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:32.119929 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:32.119896    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:44.854914 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:44.854879    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:54.321296 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:54.321262    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:54.583913 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:54.583821    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:54.694897 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:54.694855    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:55.259280 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:55.259251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:26:55.450131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:26:55.450100    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:18.798889 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:18.798813    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:20.056631 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:20.056590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:22.456189 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:22.456149    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:26.981659 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:26.981621    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"]
Jul 06 19:27:26.984913 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:26.984891    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:26.989767 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:27:26.989737    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" is forbidden: User \"system:node:ip-10-0-135-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-109.ec2.internal' and this object" podUID="e4d147b3-2b53-4199-80f5-4a670e68880f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:26.989911 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:27:26.989780    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-109.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-109.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 06 19:27:26.990062 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:27:26.990038    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-109.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-109.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 06 19:27:26.990253 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:27:26.990233    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kuadrant-operator-controller-manager-dockercfg-p7bkg\" is forbidden: User \"system:node:ip-10-0-135-109.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-109.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p7bkg\"" type="*v1.Secret"
Jul 06 19:27:27.010467 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:27.010440    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"]
Jul 06 19:27:27.110289 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:27.110245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d147b3-2b53-4199-80f5-4a670e68880f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" (UID: \"e4d147b3-2b53-4199-80f5-4a670e68880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:27.110473 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:27.110309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr6nx\" (UniqueName: \"kubernetes.io/projected/e4d147b3-2b53-4199-80f5-4a670e68880f-kube-api-access-zr6nx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" (UID: \"e4d147b3-2b53-4199-80f5-4a670e68880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:27.211244 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:27.211205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d147b3-2b53-4199-80f5-4a670e68880f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" (UID: \"e4d147b3-2b53-4199-80f5-4a670e68880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:27.211405 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:27.211287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr6nx\" (UniqueName: \"kubernetes.io/projected/e4d147b3-2b53-4199-80f5-4a670e68880f-kube-api-access-zr6nx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" (UID: \"e4d147b3-2b53-4199-80f5-4a670e68880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:27.211509 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:27.211488    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d147b3-2b53-4199-80f5-4a670e68880f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" (UID: \"e4d147b3-2b53-4199-80f5-4a670e68880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:27.455067 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:27.455026    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:27.596277 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:27.596239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:28.058374 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:28.058343    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-p7bkg\""
Jul 06 19:27:28.091472 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:28.091443    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 19:27:28.130146 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:28.130115    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:28.592135 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:28.592104    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 19:27:28.605007 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:28.604979    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr6nx\" (UniqueName: \"kubernetes.io/projected/e4d147b3-2b53-4199-80f5-4a670e68880f-kube-api-access-zr6nx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" (UID: \"e4d147b3-2b53-4199-80f5-4a670e68880f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:28.793991 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:28.793960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:28.954253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:28.954227    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"]
Jul 06 19:27:28.956376 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:27:28.956344    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d147b3_2b53_4199_80f5_4a670e68880f.slice/crio-cca53682365169f5ac0d70168e987f7134ce16ad9c0d0495e31dd720083fe5f7 WatchSource:0}: Error finding container cca53682365169f5ac0d70168e987f7134ce16ad9c0d0495e31dd720083fe5f7: Status 404 returned error can't find the container with id cca53682365169f5ac0d70168e987f7134ce16ad9c0d0495e31dd720083fe5f7
Jul 06 19:27:29.222993 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:29.222903    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:29.781947 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:29.781907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc" event={"ID":"e4d147b3-2b53-4199-80f5-4a670e68880f","Type":"ContainerStarted","Data":"cca53682365169f5ac0d70168e987f7134ce16ad9c0d0495e31dd720083fe5f7"}
Jul 06 19:27:31.871860 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:31.871801    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:32.086589 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:32.086553    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:33.761622 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:33.761580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:34.288133 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.288095    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp"]
Jul 06 19:27:34.291301 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.291286    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp"
Jul 06 19:27:34.295259 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.295239    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 06 19:27:34.295375 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.295244    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qc4r7\""
Jul 06 19:27:34.312090 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.312020    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp"]
Jul 06 19:27:34.374604 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.374565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7nfv\" (UniqueName: \"kubernetes.io/projected/da2c37ff-a0aa-4181-b3b1-75205ce1ed45-kube-api-access-k7nfv\") pod \"dns-operator-controller-manager-864dd78c4c-xwtpp\" (UID: \"da2c37ff-a0aa-4181-b3b1-75205ce1ed45\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp"
Jul 06 19:27:34.475663 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.475612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7nfv\" (UniqueName: \"kubernetes.io/projected/da2c37ff-a0aa-4181-b3b1-75205ce1ed45-kube-api-access-k7nfv\") pod \"dns-operator-controller-manager-864dd78c4c-xwtpp\" (UID: \"da2c37ff-a0aa-4181-b3b1-75205ce1ed45\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp"
Jul 06 19:27:34.493871 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.493834    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7nfv\" (UniqueName: \"kubernetes.io/projected/da2c37ff-a0aa-4181-b3b1-75205ce1ed45-kube-api-access-k7nfv\") pod \"dns-operator-controller-manager-864dd78c4c-xwtpp\" (UID: \"da2c37ff-a0aa-4181-b3b1-75205ce1ed45\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp"
Jul 06 19:27:34.601945 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.601917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp"
Jul 06 19:27:34.749036 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.749007    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp"]
Jul 06 19:27:34.751622 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:27:34.751591    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2c37ff_a0aa_4181_b3b1_75205ce1ed45.slice/crio-5f41d0175b36e5832098934f5c6e5bceb8db5f545f097198b0c42887419d7fb4 WatchSource:0}: Error finding container 5f41d0175b36e5832098934f5c6e5bceb8db5f545f097198b0c42887419d7fb4: Status 404 returned error can't find the container with id 5f41d0175b36e5832098934f5c6e5bceb8db5f545f097198b0c42887419d7fb4
Jul 06 19:27:34.803103 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:34.803074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp" event={"ID":"da2c37ff-a0aa-4181-b3b1-75205ce1ed45","Type":"ContainerStarted","Data":"5f41d0175b36e5832098934f5c6e5bceb8db5f545f097198b0c42887419d7fb4"}
Jul 06 19:27:35.867216 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:35.867170    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:35.980849 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:35.980814    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:36.814865 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:36.814832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc" event={"ID":"e4d147b3-2b53-4199-80f5-4a670e68880f","Type":"ContainerStarted","Data":"1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230"}
Jul 06 19:27:36.815081 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:36.814972    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:36.855233 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:36.855103    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc" podStartSLOduration=3.549599266 podStartE2EDuration="10.855078601s" totalImagesPullingTime="7.305479335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:36.85128343 +0000 UTC m=+461.223765163" watchObservedRunningTime="2026-07-06 19:27:36.855078601 +0000 UTC m=+461.227560334"
Jul 06 19:27:38.826416 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:38.826385    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp" event={"ID":"da2c37ff-a0aa-4181-b3b1-75205ce1ed45","Type":"ContainerStarted","Data":"ae4ced24d6c354fc528212e3ec8a1c33baba931bfdff4907adfd28e68e035f6b"}
Jul 06 19:27:38.826819 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:38.826455    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp"
Jul 06 19:27:38.850341 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:38.850288    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp" podStartSLOduration=1.816611677 podStartE2EDuration="4.850268438s" totalImagesPullingTime="3.033656761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:27:38.847995981 +0000 UTC m=+463.220477714" watchObservedRunningTime="2026-07-06 19:27:38.850268438 +0000 UTC m=+463.222750228"
Jul 06 19:27:39.270630 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.270588    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"]
Jul 06 19:27:39.275015 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.274988    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.277513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.277492    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6mgqb\""
Jul 06 19:27:39.278280 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.278247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:39.280423 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.280407    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 19:27:39.280527 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.280431    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 19:27:39.283864 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.283844    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"]
Jul 06 19:27:39.418111 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.418078    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:39.419078 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.419052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rds6l\" (UniqueName: \"kubernetes.io/projected/141b0ad9-aeef-4ef8-8874-6f366bbc03ab-kube-api-access-rds6l\") pod \"kuadrant-console-plugin-66b5774985-tnlwk\" (UID: \"141b0ad9-aeef-4ef8-8874-6f366bbc03ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.419166 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.419102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/141b0ad9-aeef-4ef8-8874-6f366bbc03ab-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tnlwk\" (UID: \"141b0ad9-aeef-4ef8-8874-6f366bbc03ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.419203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.419165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/141b0ad9-aeef-4ef8-8874-6f366bbc03ab-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tnlwk\" (UID: \"141b0ad9-aeef-4ef8-8874-6f366bbc03ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.516356 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.516322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:39.520325 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.520300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/141b0ad9-aeef-4ef8-8874-6f366bbc03ab-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tnlwk\" (UID: \"141b0ad9-aeef-4ef8-8874-6f366bbc03ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.520461 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.520341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/141b0ad9-aeef-4ef8-8874-6f366bbc03ab-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tnlwk\" (UID: \"141b0ad9-aeef-4ef8-8874-6f366bbc03ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.520461 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.520394    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rds6l\" (UniqueName: \"kubernetes.io/projected/141b0ad9-aeef-4ef8-8874-6f366bbc03ab-kube-api-access-rds6l\") pod \"kuadrant-console-plugin-66b5774985-tnlwk\" (UID: \"141b0ad9-aeef-4ef8-8874-6f366bbc03ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.521126 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.521083    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/141b0ad9-aeef-4ef8-8874-6f366bbc03ab-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tnlwk\" (UID: \"141b0ad9-aeef-4ef8-8874-6f366bbc03ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.522791 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.522775    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/141b0ad9-aeef-4ef8-8874-6f366bbc03ab-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tnlwk\" (UID: \"141b0ad9-aeef-4ef8-8874-6f366bbc03ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.530796 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.530773    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rds6l\" (UniqueName: \"kubernetes.io/projected/141b0ad9-aeef-4ef8-8874-6f366bbc03ab-kube-api-access-rds6l\") pod \"kuadrant-console-plugin-66b5774985-tnlwk\" (UID: \"141b0ad9-aeef-4ef8-8874-6f366bbc03ab\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.585616 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.585578    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"
Jul 06 19:27:39.616672 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.616641    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:39.717044 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.717008    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk"]
Jul 06 19:27:39.720473 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:27:39.720446    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod141b0ad9_aeef_4ef8_8874_6f366bbc03ab.slice/crio-b9e2f6c163665042ea0508e4a4eee392585f53124862fde38a096d3013071de5 WatchSource:0}: Error finding container b9e2f6c163665042ea0508e4a4eee392585f53124862fde38a096d3013071de5: Status 404 returned error can't find the container with id b9e2f6c163665042ea0508e4a4eee392585f53124862fde38a096d3013071de5
Jul 06 19:27:39.832113 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:39.832024    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk" event={"ID":"141b0ad9-aeef-4ef8-8874-6f366bbc03ab","Type":"ContainerStarted","Data":"b9e2f6c163665042ea0508e4a4eee392585f53124862fde38a096d3013071de5"}
Jul 06 19:27:47.823115 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:47.823086    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:47.889291 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:47.889236    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:48.056406 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:48.056364    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:49.834474 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:49.834444    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xwtpp"
Jul 06 19:27:49.961019 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:49.960982    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"]
Jul 06 19:27:49.961227 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:49.961199    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc" podUID="e4d147b3-2b53-4199-80f5-4a670e68880f" containerName="manager" containerID="cri-o://1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230" gracePeriod=2
Jul 06 19:27:49.971480 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:49.971452    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"]
Jul 06 19:27:50.012808 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.012774    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"]
Jul 06 19:27:50.013201 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.013177    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4d147b3-2b53-4199-80f5-4a670e68880f" containerName="manager"
Jul 06 19:27:50.013201 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.013203    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d147b3-2b53-4199-80f5-4a670e68880f" containerName="manager"
Jul 06 19:27:50.013386 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.013277    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4d147b3-2b53-4199-80f5-4a670e68880f" containerName="manager"
Jul 06 19:27:50.017905 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.017871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:27:50.020211 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:27:50.020182    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" is forbidden: User \"system:node:ip-10-0-135-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-109.ec2.internal' and this object" podUID="e4d147b3-2b53-4199-80f5-4a670e68880f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:27:50.058639 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.058607    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"]
Jul 06 19:27:50.114409 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.114374    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxjvq\" (UniqueName: \"kubernetes.io/projected/79250b87-b26e-4c35-8042-212844ae52ec-kube-api-access-zxjvq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkkpd\" (UID: \"79250b87-b26e-4c35-8042-212844ae52ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:27:50.114607 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.114435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79250b87-b26e-4c35-8042-212844ae52ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkkpd\" (UID: \"79250b87-b26e-4c35-8042-212844ae52ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:27:50.215525 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.215490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79250b87-b26e-4c35-8042-212844ae52ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkkpd\" (UID: \"79250b87-b26e-4c35-8042-212844ae52ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:27:50.215734 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.215622    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxjvq\" (UniqueName: \"kubernetes.io/projected/79250b87-b26e-4c35-8042-212844ae52ec-kube-api-access-zxjvq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkkpd\" (UID: \"79250b87-b26e-4c35-8042-212844ae52ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:27:50.215919 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.215898    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79250b87-b26e-4c35-8042-212844ae52ec-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkkpd\" (UID: \"79250b87-b26e-4c35-8042-212844ae52ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:27:50.235962 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.235932    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxjvq\" (UniqueName: \"kubernetes.io/projected/79250b87-b26e-4c35-8042-212844ae52ec-kube-api-access-zxjvq\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dkkpd\" (UID: \"79250b87-b26e-4c35-8042-212844ae52ec\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:27:50.334486 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.334448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:27:50.364557 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.364460    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:50.514007 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:50.513972    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:54.144163 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:54.144125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:54.248058 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:54.248022    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:54.664695 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:54.664661    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:54.782073 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:54.782036    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:57.869063 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:57.869028    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:27:57.997344 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:27:57.997300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:03.587925 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.587894    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"]
Jul 06 19:28:03.590831 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:28:03.590801    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79250b87_b26e_4c35_8042_212844ae52ec.slice/crio-6d4d87eaf05bf7d4778b829943a140815aa703f072518635b0f8f812866e1b21 WatchSource:0}: Error finding container 6d4d87eaf05bf7d4778b829943a140815aa703f072518635b0f8f812866e1b21: Status 404 returned error can't find the container with id 6d4d87eaf05bf7d4778b829943a140815aa703f072518635b0f8f812866e1b21
Jul 06 19:28:03.596970 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.596949    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:28:03.599197 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:28:03.599168    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" is forbidden: User \"system:node:ip-10-0-135-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-109.ec2.internal' and this object" podUID="e4d147b3-2b53-4199-80f5-4a670e68880f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:28:03.641274 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.641251    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d147b3-2b53-4199-80f5-4a670e68880f-extensions-socket-volume\") pod \"e4d147b3-2b53-4199-80f5-4a670e68880f\" (UID: \"e4d147b3-2b53-4199-80f5-4a670e68880f\") "
Jul 06 19:28:03.641415 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.641305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr6nx\" (UniqueName: \"kubernetes.io/projected/e4d147b3-2b53-4199-80f5-4a670e68880f-kube-api-access-zr6nx\") pod \"e4d147b3-2b53-4199-80f5-4a670e68880f\" (UID: \"e4d147b3-2b53-4199-80f5-4a670e68880f\") "
Jul 06 19:28:03.641790 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.641762    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4d147b3-2b53-4199-80f5-4a670e68880f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e4d147b3-2b53-4199-80f5-4a670e68880f" (UID: "e4d147b3-2b53-4199-80f5-4a670e68880f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:28:03.643313 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.643288    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4d147b3-2b53-4199-80f5-4a670e68880f-kube-api-access-zr6nx" (OuterVolumeSpecName: "kube-api-access-zr6nx") pod "e4d147b3-2b53-4199-80f5-4a670e68880f" (UID: "e4d147b3-2b53-4199-80f5-4a670e68880f"). InnerVolumeSpecName "kube-api-access-zr6nx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:28:03.742819 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.742733    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr6nx\" (UniqueName: \"kubernetes.io/projected/e4d147b3-2b53-4199-80f5-4a670e68880f-kube-api-access-zr6nx\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:28:03.742819 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.742763    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e4d147b3-2b53-4199-80f5-4a670e68880f-extensions-socket-volume\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:28:03.946004 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.945961    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk" event={"ID":"141b0ad9-aeef-4ef8-8874-6f366bbc03ab","Type":"ContainerStarted","Data":"5a73febaa315d97dcfa2f666626feb092727ae57d7150d71dcc08505182baf88"}
Jul 06 19:28:03.947276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.947252    2579 generic.go:356] "Generic (PLEG): container finished" podID="e4d147b3-2b53-4199-80f5-4a670e68880f" containerID="1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230" exitCode=0
Jul 06 19:28:03.947400 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.947287    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:28:03.947400 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.947348    2579 scope.go:117] "RemoveContainer" containerID="1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230"
Jul 06 19:28:03.948389 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:28:03.948250    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" is forbidden: User \"system:node:ip-10-0-135-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-109.ec2.internal' and this object" podUID="e4d147b3-2b53-4199-80f5-4a670e68880f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:28:03.948980 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.948959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd" event={"ID":"79250b87-b26e-4c35-8042-212844ae52ec","Type":"ContainerStarted","Data":"65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b"}
Jul 06 19:28:03.949067 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.948999    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd" event={"ID":"79250b87-b26e-4c35-8042-212844ae52ec","Type":"ContainerStarted","Data":"6d4d87eaf05bf7d4778b829943a140815aa703f072518635b0f8f812866e1b21"}
Jul 06 19:28:03.949117 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.949067    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:28:03.956687 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.956668    2579 scope.go:117] "RemoveContainer" containerID="1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230"
Jul 06 19:28:03.957022 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:28:03.956997    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230\": container with ID starting with 1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230 not found: ID does not exist" containerID="1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230"
Jul 06 19:28:03.957092 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.957031    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230"} err="failed to get container status \"1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230\": rpc error: code = NotFound desc = could not find container \"1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230\": container with ID starting with 1c40a0cb63ac27a0a185d5d62a43c1e02cd98e5b71504b28500c3ab631115230 not found: ID does not exist"
Jul 06 19:28:03.965274 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.965231    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tnlwk" podStartSLOduration=1.1596654339999999 podStartE2EDuration="24.965216137s" totalImagesPullingTime="23.805550703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:03.963382081 +0000 UTC m=+488.335863813" watchObservedRunningTime="2026-07-06 19:28:03.965216137 +0000 UTC m=+488.337697868"
Jul 06 19:28:03.965455 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:28:03.965429    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hlqzc\" is forbidden: User \"system:node:ip-10-0-135-109.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-109.ec2.internal' and this object" podUID="e4d147b3-2b53-4199-80f5-4a670e68880f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hlqzc"
Jul 06 19:28:03.995137 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:03.995043    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd" podStartSLOduration=14.995027473 podStartE2EDuration="14.995027473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:27:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:03.993918877 +0000 UTC m=+488.366400630" watchObservedRunningTime="2026-07-06 19:28:03.995027473 +0000 UTC m=+488.367509205"
Jul 06 19:28:04.098869 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:04.098840    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4d147b3-2b53-4199-80f5-4a670e68880f" path="/var/lib/kubelet/pods/e4d147b3-2b53-4199-80f5-4a670e68880f/volumes"
Jul 06 19:28:05.136861 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:05.136830    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:05.228626 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:05.228590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:06.848882 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:06.848845    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:06.937846 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:06.937812    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:08.936145 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:08.936113    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"]
Jul 06 19:28:08.936525 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:08.936302    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd" podUID="79250b87-b26e-4c35-8042-212844ae52ec" containerName="manager" containerID="cri-o://65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b" gracePeriod=10
Jul 06 19:28:08.938123 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:08.938099    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:28:09.182453 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.182426    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:28:09.291529 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.291441    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxjvq\" (UniqueName: \"kubernetes.io/projected/79250b87-b26e-4c35-8042-212844ae52ec-kube-api-access-zxjvq\") pod \"79250b87-b26e-4c35-8042-212844ae52ec\" (UID: \"79250b87-b26e-4c35-8042-212844ae52ec\") "
Jul 06 19:28:09.291529 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.291489    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79250b87-b26e-4c35-8042-212844ae52ec-extensions-socket-volume\") pod \"79250b87-b26e-4c35-8042-212844ae52ec\" (UID: \"79250b87-b26e-4c35-8042-212844ae52ec\") "
Jul 06 19:28:09.291875 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.291850    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79250b87-b26e-4c35-8042-212844ae52ec-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "79250b87-b26e-4c35-8042-212844ae52ec" (UID: "79250b87-b26e-4c35-8042-212844ae52ec"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:28:09.293543 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.293521    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79250b87-b26e-4c35-8042-212844ae52ec-kube-api-access-zxjvq" (OuterVolumeSpecName: "kube-api-access-zxjvq") pod "79250b87-b26e-4c35-8042-212844ae52ec" (UID: "79250b87-b26e-4c35-8042-212844ae52ec"). InnerVolumeSpecName "kube-api-access-zxjvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:28:09.392991 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.392957    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79250b87-b26e-4c35-8042-212844ae52ec-extensions-socket-volume\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:28:09.392991 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.392984    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxjvq\" (UniqueName: \"kubernetes.io/projected/79250b87-b26e-4c35-8042-212844ae52ec-kube-api-access-zxjvq\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:28:09.975495 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.975457    2579 generic.go:356] "Generic (PLEG): container finished" podID="79250b87-b26e-4c35-8042-212844ae52ec" containerID="65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b" exitCode=0
Jul 06 19:28:09.976008 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.975509    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"
Jul 06 19:28:09.976008 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.975513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd" event={"ID":"79250b87-b26e-4c35-8042-212844ae52ec","Type":"ContainerDied","Data":"65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b"}
Jul 06 19:28:09.976008 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.975640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd" event={"ID":"79250b87-b26e-4c35-8042-212844ae52ec","Type":"ContainerDied","Data":"6d4d87eaf05bf7d4778b829943a140815aa703f072518635b0f8f812866e1b21"}
Jul 06 19:28:09.976008 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.975665    2579 scope.go:117] "RemoveContainer" containerID="65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b"
Jul 06 19:28:09.984109 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.984089    2579 scope.go:117] "RemoveContainer" containerID="65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b"
Jul 06 19:28:09.984361 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:28:09.984335    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b\": container with ID starting with 65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b not found: ID does not exist" containerID="65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b"
Jul 06 19:28:09.984418 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:09.984373    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b"} err="failed to get container status \"65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b\": rpc error: code = NotFound desc = could not find container \"65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b\": container with ID starting with 65ca544aa0f5d02547e528aa160b5db4daf971cfa0a86de96b2c4476ea49d42b not found: ID does not exist"
Jul 06 19:28:10.008447 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:10.008410    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"]
Jul 06 19:28:10.021389 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:10.021359    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dkkpd"]
Jul 06 19:28:10.098414 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:10.098380    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79250b87-b26e-4c35-8042-212844ae52ec" path="/var/lib/kubelet/pods/79250b87-b26e-4c35-8042-212844ae52ec/volumes"
Jul 06 19:28:10.510335 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:10.510284    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:10.713865 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:10.713821    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:25.735438 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.735408    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"]
Jul 06 19:28:25.735920 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.735739    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79250b87-b26e-4c35-8042-212844ae52ec" containerName="manager"
Jul 06 19:28:25.735920 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.735751    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="79250b87-b26e-4c35-8042-212844ae52ec" containerName="manager"
Jul 06 19:28:25.735920 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.735799    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="79250b87-b26e-4c35-8042-212844ae52ec" containerName="manager"
Jul 06 19:28:25.747812 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.747771    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:25.751606 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.751583    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ghdp8\""
Jul 06 19:28:25.768170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.764638    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"]
Jul 06 19:28:25.780215 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.780180    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:25.932165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.932134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:25.932165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.932168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:25.932369 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.932211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:25.932369 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.932236    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:25.932369 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.932272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:25.932369 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.932319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:25.932369 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.932333    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq4r7\" (UniqueName: \"kubernetes.io/projected/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-kube-api-access-lq4r7\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:25.932369 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.932355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:25.932559 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.932434    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:25.992225 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:25.992141    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:26.033391 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.033391 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.033620 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.033620 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033456    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.033620 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.033620 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033581    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.033846 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.033846 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq4r7\" (UniqueName: \"kubernetes.io/projected/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-kube-api-access-lq4r7\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.033846 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.033846 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033804    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.034050 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.033868    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.034141 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.034122    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.034210 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.034164    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.034265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.034237    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.035830 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.035809    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.036430 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.036405    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.044473 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.044447    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq4r7\" (UniqueName: \"kubernetes.io/projected/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-kube-api-access-lq4r7\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.044752 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.044732    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cd1f295-3fcb-437c-97d7-be47b0fd14d3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-b4bpp\" (UID: \"6cd1f295-3fcb-437c-97d7-be47b0fd14d3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.059607 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.059584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:26.233529 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.233501    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"]
Jul 06 19:28:26.235536 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:28:26.235489    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd1f295_3fcb_437c_97d7_be47b0fd14d3.slice/crio-aae54c9f8c009c3dfd11b3882f0ad8772752fa7226cf6cf319e454821cd441b5 WatchSource:0}: Error finding container aae54c9f8c009c3dfd11b3882f0ad8772752fa7226cf6cf319e454821cd441b5: Status 404 returned error can't find the container with id aae54c9f8c009c3dfd11b3882f0ad8772752fa7226cf6cf319e454821cd441b5
Jul 06 19:28:26.237595 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.237569    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:28:26.237655 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.237631    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:28:26.237716 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:26.237661    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:28:27.046514 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:27.046482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp" event={"ID":"6cd1f295-3fcb-437c-97d7-be47b0fd14d3","Type":"ContainerStarted","Data":"54f10c76e413f20ce52b67f46f18e6c840b2133ea8c6bac77861f44326731dfd"}
Jul 06 19:28:27.046877 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:27.046533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp" event={"ID":"6cd1f295-3fcb-437c-97d7-be47b0fd14d3","Type":"ContainerStarted","Data":"aae54c9f8c009c3dfd11b3882f0ad8772752fa7226cf6cf319e454821cd441b5"}
Jul 06 19:28:27.059768 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:27.059731    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:27.065516 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:27.065488    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:27.073120 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:27.073067    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp" podStartSLOduration=2.073045601 podStartE2EDuration="2.073045601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:27.070255703 +0000 UTC m=+511.442737433" watchObservedRunningTime="2026-07-06 19:28:27.073045601 +0000 UTC m=+511.445527335"
Jul 06 19:28:28.051186 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.051159    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:28.052021 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.052003    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:28:28.163295 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.163260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:28.168144 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.168115    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"]
Jul 06 19:28:28.242202 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.242166    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"]
Jul 06 19:28:28.242358 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.242303    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:28.245633 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.245611    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 19:28:28.302925 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.302854    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"]
Jul 06 19:28:28.351760 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.351728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltxcp\" (UniqueName: \"kubernetes.io/projected/0b514b92-d2fb-40ae-8158-2fcb757d4b78-kube-api-access-ltxcp\") pod \"limitador-limitador-64c94fd64f-vdbb8\" (UID: \"0b514b92-d2fb-40ae-8158-2fcb757d4b78\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:28.351936 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.351775    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0b514b92-d2fb-40ae-8158-2fcb757d4b78-config-file\") pod \"limitador-limitador-64c94fd64f-vdbb8\" (UID: \"0b514b92-d2fb-40ae-8158-2fcb757d4b78\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:28.362499 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.362471    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:28.452399 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.452363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltxcp\" (UniqueName: \"kubernetes.io/projected/0b514b92-d2fb-40ae-8158-2fcb757d4b78-kube-api-access-ltxcp\") pod \"limitador-limitador-64c94fd64f-vdbb8\" (UID: \"0b514b92-d2fb-40ae-8158-2fcb757d4b78\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:28.452596 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.452407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0b514b92-d2fb-40ae-8158-2fcb757d4b78-config-file\") pod \"limitador-limitador-64c94fd64f-vdbb8\" (UID: \"0b514b92-d2fb-40ae-8158-2fcb757d4b78\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:28.453024 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.453005    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0b514b92-d2fb-40ae-8158-2fcb757d4b78-config-file\") pod \"limitador-limitador-64c94fd64f-vdbb8\" (UID: \"0b514b92-d2fb-40ae-8158-2fcb757d4b78\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:28.469784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.469758    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltxcp\" (UniqueName: \"kubernetes.io/projected/0b514b92-d2fb-40ae-8158-2fcb757d4b78-kube-api-access-ltxcp\") pod \"limitador-limitador-64c94fd64f-vdbb8\" (UID: \"0b514b92-d2fb-40ae-8158-2fcb757d4b78\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:28.511814 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.511785    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:28.554026 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.553948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:28.709566 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:28.709402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"]
Jul 06 19:28:28.712212 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:28:28.712181    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b514b92_d2fb_40ae_8158_2fcb757d4b78.slice/crio-1c4dedff122b17336c7632c0d3dc907297fc709bb00b8cd6ec1c576d330c4630 WatchSource:0}: Error finding container 1c4dedff122b17336c7632c0d3dc907297fc709bb00b8cd6ec1c576d330c4630: Status 404 returned error can't find the container with id 1c4dedff122b17336c7632c0d3dc907297fc709bb00b8cd6ec1c576d330c4630
Jul 06 19:28:29.057534 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.057495    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8" event={"ID":"0b514b92-d2fb-40ae-8158-2fcb757d4b78","Type":"ContainerStarted","Data":"1c4dedff122b17336c7632c0d3dc907297fc709bb00b8cd6ec1c576d330c4630"}
Jul 06 19:28:29.097233 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.097196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:29.197226 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.197182    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:29.287817 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.287787    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gtn2"]
Jul 06 19:28:29.607718 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.607660    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gtn2"]
Jul 06 19:28:29.607911 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.607815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7gtn2"
Jul 06 19:28:29.610919 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.610898    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m7fq6\""
Jul 06 19:28:29.761406 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.761371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqhls\" (UniqueName: \"kubernetes.io/projected/b8a68845-47b3-40e7-9c26-23c226b44fb7-kube-api-access-gqhls\") pod \"authorino-75d556bd77-7gtn2\" (UID: \"b8a68845-47b3-40e7-9c26-23c226b44fb7\") " pod="kuadrant-system/authorino-75d556bd77-7gtn2"
Jul 06 19:28:29.862554 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.862473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhls\" (UniqueName: \"kubernetes.io/projected/b8a68845-47b3-40e7-9c26-23c226b44fb7-kube-api-access-gqhls\") pod \"authorino-75d556bd77-7gtn2\" (UID: \"b8a68845-47b3-40e7-9c26-23c226b44fb7\") " pod="kuadrant-system/authorino-75d556bd77-7gtn2"
Jul 06 19:28:29.872820 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.872784    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqhls\" (UniqueName: \"kubernetes.io/projected/b8a68845-47b3-40e7-9c26-23c226b44fb7-kube-api-access-gqhls\") pod \"authorino-75d556bd77-7gtn2\" (UID: \"b8a68845-47b3-40e7-9c26-23c226b44fb7\") " pod="kuadrant-system/authorino-75d556bd77-7gtn2"
Jul 06 19:28:29.916767 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:29.916734    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7gtn2"
Jul 06 19:28:30.123331 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:30.123304    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gtn2"]
Jul 06 19:28:30.127572 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:28:30.127543    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8a68845_47b3_40e7_9c26_23c226b44fb7.slice/crio-33fda4f966be6d78f947f5a31653e5723adf6d31019f783e61bb7f422490f727 WatchSource:0}: Error finding container 33fda4f966be6d78f947f5a31653e5723adf6d31019f783e61bb7f422490f727: Status 404 returned error can't find the container with id 33fda4f966be6d78f947f5a31653e5723adf6d31019f783e61bb7f422490f727
Jul 06 19:28:31.073221 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:31.073188    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7gtn2" event={"ID":"b8a68845-47b3-40e7-9c26-23c226b44fb7","Type":"ContainerStarted","Data":"33fda4f966be6d78f947f5a31653e5723adf6d31019f783e61bb7f422490f727"}
Jul 06 19:28:35.094781 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:35.094736    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8" event={"ID":"0b514b92-d2fb-40ae-8158-2fcb757d4b78","Type":"ContainerStarted","Data":"413c0da9a141d97ad2df8e6eec358321c193aa8ae55b9c600fff11cc10305b62"}
Jul 06 19:28:35.095304 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:35.095006    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:35.096793 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:35.096764    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7gtn2" event={"ID":"b8a68845-47b3-40e7-9c26-23c226b44fb7","Type":"ContainerStarted","Data":"d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9"}
Jul 06 19:28:35.113652 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:35.113595    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8" podStartSLOduration=0.857361648 podStartE2EDuration="7.113577659s" totalImagesPullingTime="6.256216011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:35.112306605 +0000 UTC m=+519.484788336" watchObservedRunningTime="2026-07-06 19:28:35.113577659 +0000 UTC m=+519.486059395"
Jul 06 19:28:35.129471 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:35.129419    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7gtn2" podStartSLOduration=1.243793083 podStartE2EDuration="6.129402447s" totalImagesPullingTime="4.885609364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:35.128436659 +0000 UTC m=+519.500918392" watchObservedRunningTime="2026-07-06 19:28:35.129402447 +0000 UTC m=+519.501884179"
Jul 06 19:28:43.259498 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:43.259461    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"]
Jul 06 19:28:43.259909 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:43.259640    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8" podUID="0b514b92-d2fb-40ae-8158-2fcb757d4b78" containerName="limitador" containerID="cri-o://413c0da9a141d97ad2df8e6eec358321c193aa8ae55b9c600fff11cc10305b62" gracePeriod=30
Jul 06 19:28:43.261650 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:43.261629    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:44.135618 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:44.135574    2579 generic.go:356] "Generic (PLEG): container finished" podID="0b514b92-d2fb-40ae-8158-2fcb757d4b78" containerID="413c0da9a141d97ad2df8e6eec358321c193aa8ae55b9c600fff11cc10305b62" exitCode=0
Jul 06 19:28:44.135776 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:44.135750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8" event={"ID":"0b514b92-d2fb-40ae-8158-2fcb757d4b78","Type":"ContainerDied","Data":"413c0da9a141d97ad2df8e6eec358321c193aa8ae55b9c600fff11cc10305b62"}
Jul 06 19:28:44.198006 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:44.197978    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:44.285763 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:44.285731    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltxcp\" (UniqueName: \"kubernetes.io/projected/0b514b92-d2fb-40ae-8158-2fcb757d4b78-kube-api-access-ltxcp\") pod \"0b514b92-d2fb-40ae-8158-2fcb757d4b78\" (UID: \"0b514b92-d2fb-40ae-8158-2fcb757d4b78\") "
Jul 06 19:28:44.286137 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:44.285777    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0b514b92-d2fb-40ae-8158-2fcb757d4b78-config-file\") pod \"0b514b92-d2fb-40ae-8158-2fcb757d4b78\" (UID: \"0b514b92-d2fb-40ae-8158-2fcb757d4b78\") "
Jul 06 19:28:44.286181 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:44.286136    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b514b92-d2fb-40ae-8158-2fcb757d4b78-config-file" (OuterVolumeSpecName: "config-file") pod "0b514b92-d2fb-40ae-8158-2fcb757d4b78" (UID: "0b514b92-d2fb-40ae-8158-2fcb757d4b78"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:28:44.287750 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:44.287726    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b514b92-d2fb-40ae-8158-2fcb757d4b78-kube-api-access-ltxcp" (OuterVolumeSpecName: "kube-api-access-ltxcp") pod "0b514b92-d2fb-40ae-8158-2fcb757d4b78" (UID: "0b514b92-d2fb-40ae-8158-2fcb757d4b78"). InnerVolumeSpecName "kube-api-access-ltxcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:28:44.386591 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:44.386560    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltxcp\" (UniqueName: \"kubernetes.io/projected/0b514b92-d2fb-40ae-8158-2fcb757d4b78-kube-api-access-ltxcp\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:28:44.386591 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:44.386587    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0b514b92-d2fb-40ae-8158-2fcb757d4b78-config-file\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:28:45.141244 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:45.141207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8" event={"ID":"0b514b92-d2fb-40ae-8158-2fcb757d4b78","Type":"ContainerDied","Data":"1c4dedff122b17336c7632c0d3dc907297fc709bb00b8cd6ec1c576d330c4630"}
Jul 06 19:28:45.141407 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:45.141264    2579 scope.go:117] "RemoveContainer" containerID="413c0da9a141d97ad2df8e6eec358321c193aa8ae55b9c600fff11cc10305b62"
Jul 06 19:28:45.141407 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:45.141219    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"
Jul 06 19:28:45.164096 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:45.164061    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"]
Jul 06 19:28:45.168957 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:45.168932    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdbb8"]
Jul 06 19:28:46.098588 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:46.098558    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b514b92-d2fb-40ae-8158-2fcb757d4b78" path="/var/lib/kubelet/pods/0b514b92-d2fb-40ae-8158-2fcb757d4b78/volumes"
Jul 06 19:28:49.700083 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.699997    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-bvg2x"]
Jul 06 19:28:49.700615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.700328    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b514b92-d2fb-40ae-8158-2fcb757d4b78" containerName="limitador"
Jul 06 19:28:49.700615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.700341    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b514b92-d2fb-40ae-8158-2fcb757d4b78" containerName="limitador"
Jul 06 19:28:49.700615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.700399    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b514b92-d2fb-40ae-8158-2fcb757d4b78" containerName="limitador"
Jul 06 19:28:49.703171 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.703147    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-bvg2x"
Jul 06 19:28:49.706418 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.706397    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 06 19:28:49.706791 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.706773    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mfbwm\""
Jul 06 19:28:49.712738 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.712688    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-bvg2x"]
Jul 06 19:28:49.745219 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.745188    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:28:49.831029 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.830998    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qddck\" (UniqueName: \"kubernetes.io/projected/835aa2bb-6cd8-46c4-b318-8b646c9772ba-kube-api-access-qddck\") pod \"postgres-69fb4594cf-bvg2x\" (UID: \"835aa2bb-6cd8-46c4-b318-8b646c9772ba\") " pod="opendatahub/postgres-69fb4594cf-bvg2x"
Jul 06 19:28:49.831209 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.831139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/835aa2bb-6cd8-46c4-b318-8b646c9772ba-data\") pod \"postgres-69fb4594cf-bvg2x\" (UID: \"835aa2bb-6cd8-46c4-b318-8b646c9772ba\") " pod="opendatahub/postgres-69fb4594cf-bvg2x"
Jul 06 19:28:49.932401 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.932355    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qddck\" (UniqueName: \"kubernetes.io/projected/835aa2bb-6cd8-46c4-b318-8b646c9772ba-kube-api-access-qddck\") pod \"postgres-69fb4594cf-bvg2x\" (UID: \"835aa2bb-6cd8-46c4-b318-8b646c9772ba\") " pod="opendatahub/postgres-69fb4594cf-bvg2x"
Jul 06 19:28:49.932591 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.932459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/835aa2bb-6cd8-46c4-b318-8b646c9772ba-data\") pod \"postgres-69fb4594cf-bvg2x\" (UID: \"835aa2bb-6cd8-46c4-b318-8b646c9772ba\") " pod="opendatahub/postgres-69fb4594cf-bvg2x"
Jul 06 19:28:49.932805 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.932790    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/835aa2bb-6cd8-46c4-b318-8b646c9772ba-data\") pod \"postgres-69fb4594cf-bvg2x\" (UID: \"835aa2bb-6cd8-46c4-b318-8b646c9772ba\") " pod="opendatahub/postgres-69fb4594cf-bvg2x"
Jul 06 19:28:49.941927 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:49.941901    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qddck\" (UniqueName: \"kubernetes.io/projected/835aa2bb-6cd8-46c4-b318-8b646c9772ba-kube-api-access-qddck\") pod \"postgres-69fb4594cf-bvg2x\" (UID: \"835aa2bb-6cd8-46c4-b318-8b646c9772ba\") " pod="opendatahub/postgres-69fb4594cf-bvg2x"
Jul 06 19:28:50.014123 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:50.014043    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-bvg2x"
Jul 06 19:28:50.147809 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:50.147788    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-bvg2x"]
Jul 06 19:28:50.150255 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:28:50.150224    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835aa2bb_6cd8_46c4_b318_8b646c9772ba.slice/crio-b935dcceacf7934b836ac7bbc6f6cb7eb3ae614a468b8746f4605a222e51a736 WatchSource:0}: Error finding container b935dcceacf7934b836ac7bbc6f6cb7eb3ae614a468b8746f4605a222e51a736: Status 404 returned error can't find the container with id b935dcceacf7934b836ac7bbc6f6cb7eb3ae614a468b8746f4605a222e51a736
Jul 06 19:28:50.163656 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:50.163627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-bvg2x" event={"ID":"835aa2bb-6cd8-46c4-b318-8b646c9772ba","Type":"ContainerStarted","Data":"b935dcceacf7934b836ac7bbc6f6cb7eb3ae614a468b8746f4605a222e51a736"}
Jul 06 19:28:55.193689 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:55.193655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-bvg2x" event={"ID":"835aa2bb-6cd8-46c4-b318-8b646c9772ba","Type":"ContainerStarted","Data":"18219521433c763ad6d001b993ec660f9b5ec2195ca51d23f084dae70cf0e4cb"}
Jul 06 19:28:55.194086 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:28:55.193814    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-bvg2x"
Jul 06 19:29:01.227150 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:01.227119    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-bvg2x"
Jul 06 19:29:01.250818 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:01.250765    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-bvg2x" podStartSLOduration=7.714370949 podStartE2EDuration="12.250748216s" totalImagesPullingTime="4.536377267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:28:55.222017047 +0000 UTC m=+539.594498778" watchObservedRunningTime="2026-07-06 19:29:01.250748216 +0000 UTC m=+545.623229949"
Jul 06 19:29:01.561344 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:01.561262    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:01.794731 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:01.794638    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:03.425579 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:03.425543    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gtn2"]
Jul 06 19:29:03.426051 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:03.425736    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7gtn2" podUID="b8a68845-47b3-40e7-9c26-23c226b44fb7" containerName="authorino" containerID="cri-o://d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9" gracePeriod=30
Jul 06 19:29:03.678929 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:03.678870    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7gtn2"
Jul 06 19:29:03.752972 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:03.752937    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqhls\" (UniqueName: \"kubernetes.io/projected/b8a68845-47b3-40e7-9c26-23c226b44fb7-kube-api-access-gqhls\") pod \"b8a68845-47b3-40e7-9c26-23c226b44fb7\" (UID: \"b8a68845-47b3-40e7-9c26-23c226b44fb7\") "
Jul 06 19:29:03.755002 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:03.754978    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8a68845-47b3-40e7-9c26-23c226b44fb7-kube-api-access-gqhls" (OuterVolumeSpecName: "kube-api-access-gqhls") pod "b8a68845-47b3-40e7-9c26-23c226b44fb7" (UID: "b8a68845-47b3-40e7-9c26-23c226b44fb7"). InnerVolumeSpecName "kube-api-access-gqhls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:29:03.854274 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:03.854244    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqhls\" (UniqueName: \"kubernetes.io/projected/b8a68845-47b3-40e7-9c26-23c226b44fb7-kube-api-access-gqhls\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:29:04.230819 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:04.230780    2579 generic.go:356] "Generic (PLEG): container finished" podID="b8a68845-47b3-40e7-9c26-23c226b44fb7" containerID="d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9" exitCode=0
Jul 06 19:29:04.230819 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:04.230822    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7gtn2"
Jul 06 19:29:04.231084 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:04.230867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7gtn2" event={"ID":"b8a68845-47b3-40e7-9c26-23c226b44fb7","Type":"ContainerDied","Data":"d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9"}
Jul 06 19:29:04.231084 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:04.230910    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7gtn2" event={"ID":"b8a68845-47b3-40e7-9c26-23c226b44fb7","Type":"ContainerDied","Data":"33fda4f966be6d78f947f5a31653e5723adf6d31019f783e61bb7f422490f727"}
Jul 06 19:29:04.231084 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:04.230934    2579 scope.go:117] "RemoveContainer" containerID="d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9"
Jul 06 19:29:04.239192 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:04.239174    2579 scope.go:117] "RemoveContainer" containerID="d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9"
Jul 06 19:29:04.239451 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:29:04.239434    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9\": container with ID starting with d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9 not found: ID does not exist" containerID="d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9"
Jul 06 19:29:04.239501 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:04.239460    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9"} err="failed to get container status \"d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9\": rpc error: code = NotFound desc = could not find container \"d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9\": container with ID starting with d05627c5db59cff5d7eff5051adf259682d237e1bbfd013087b252512c987ab9 not found: ID does not exist"
Jul 06 19:29:04.294049 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:04.294008    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gtn2"]
Jul 06 19:29:04.314105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:04.314070    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gtn2"]
Jul 06 19:29:06.098337 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:06.098302    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8a68845-47b3-40e7-9c26-23c226b44fb7" path="/var/lib/kubelet/pods/b8a68845-47b3-40e7-9c26-23c226b44fb7/volumes"
Jul 06 19:29:07.865243 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.865196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:07.872114 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.872074    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7d4df5c94-4pwpp"]
Jul 06 19:29:07.872478 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.872461    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8a68845-47b3-40e7-9c26-23c226b44fb7" containerName="authorino"
Jul 06 19:29:07.872542 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.872479    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8a68845-47b3-40e7-9c26-23c226b44fb7" containerName="authorino"
Jul 06 19:29:07.872599 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.872543    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8a68845-47b3-40e7-9c26-23c226b44fb7" containerName="authorino"
Jul 06 19:29:07.944356 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.944318    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4df5c94-4pwpp"]
Jul 06 19:29:07.944517 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.944427    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:07.947375 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.947346    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:29:07.947610 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.947591    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c8ljl\""
Jul 06 19:29:07.947681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.947604    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:29:07.974350 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:07.974313    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:08.039776 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.039737    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54c7c76bb-kh9ns"]
Jul 06 19:29:08.065243 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.065211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:08.088277 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.088233    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c7c76bb-kh9ns"]
Jul 06 19:29:08.088429 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.088359    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.092637 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.092612    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3d3720-e175-4720-b441-ead137211802-service-ca\") pod \"maas-controller-7d4df5c94-4pwpp\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") " pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:08.092792 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.092772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2llgq\" (UniqueName: \"kubernetes.io/projected/2e3d3720-e175-4720-b441-ead137211802-kube-api-access-2llgq\") pod \"maas-controller-7d4df5c94-4pwpp\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") " pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:08.092887 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.092808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e3d3720-e175-4720-b441-ead137211802-webhook-cert\") pod \"maas-controller-7d4df5c94-4pwpp\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") " pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:08.193889 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.193805    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e3d3720-e175-4720-b441-ead137211802-webhook-cert\") pod \"maas-controller-7d4df5c94-4pwpp\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") " pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:08.193889 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.193850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3d3720-e175-4720-b441-ead137211802-service-ca\") pod \"maas-controller-7d4df5c94-4pwpp\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") " pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:08.193889 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.193890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdxq8\" (UniqueName: \"kubernetes.io/projected/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-kube-api-access-tdxq8\") pod \"maas-controller-54c7c76bb-kh9ns\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") " pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.194189 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.193964    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-service-ca\") pod \"maas-controller-54c7c76bb-kh9ns\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") " pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.194189 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:29:08.193974    2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 06 19:29:08.194189 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.194022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-webhook-cert\") pod \"maas-controller-54c7c76bb-kh9ns\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") " pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.194189 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:29:08.194061    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e3d3720-e175-4720-b441-ead137211802-webhook-cert podName:2e3d3720-e175-4720-b441-ead137211802 nodeName:}" failed. No retries permitted until 2026-07-06 19:29:08.694038661 +0000 UTC m=+553.066520375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/2e3d3720-e175-4720-b441-ead137211802-webhook-cert") pod "maas-controller-7d4df5c94-4pwpp" (UID: "2e3d3720-e175-4720-b441-ead137211802") : secret "maas-controller-webhook-cert" not found
Jul 06 19:29:08.194189 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.194154    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2llgq\" (UniqueName: \"kubernetes.io/projected/2e3d3720-e175-4720-b441-ead137211802-kube-api-access-2llgq\") pod \"maas-controller-7d4df5c94-4pwpp\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") " pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:08.194602 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.194584    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3d3720-e175-4720-b441-ead137211802-service-ca\") pod \"maas-controller-7d4df5c94-4pwpp\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") " pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:08.203396 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.203369    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2llgq\" (UniqueName: \"kubernetes.io/projected/2e3d3720-e175-4720-b441-ead137211802-kube-api-access-2llgq\") pod \"maas-controller-7d4df5c94-4pwpp\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") " pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:08.294578 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.294538    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdxq8\" (UniqueName: \"kubernetes.io/projected/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-kube-api-access-tdxq8\") pod \"maas-controller-54c7c76bb-kh9ns\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") " pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.294788 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.294613    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-service-ca\") pod \"maas-controller-54c7c76bb-kh9ns\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") " pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.294788 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.294645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-webhook-cert\") pod \"maas-controller-54c7c76bb-kh9ns\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") " pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.294882 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:29:08.294831    2579 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 06 19:29:08.294925 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:29:08.294917    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-webhook-cert podName:fd66faef-2665-4ce6-bd36-8d13e7ce7e6d nodeName:}" failed. No retries permitted until 2026-07-06 19:29:08.794896852 +0000 UTC m=+553.167378577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-webhook-cert") pod "maas-controller-54c7c76bb-kh9ns" (UID: "fd66faef-2665-4ce6-bd36-8d13e7ce7e6d") : secret "maas-controller-webhook-cert" not found
Jul 06 19:29:08.295227 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.295208    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-service-ca\") pod \"maas-controller-54c7c76bb-kh9ns\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") " pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.304216 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.304181    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdxq8\" (UniqueName: \"kubernetes.io/projected/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-kube-api-access-tdxq8\") pod \"maas-controller-54c7c76bb-kh9ns\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") " pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.420559 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.420522    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:08.698366 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.698327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e3d3720-e175-4720-b441-ead137211802-webhook-cert\") pod \"maas-controller-7d4df5c94-4pwpp\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") " pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:08.700796 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.700763    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e3d3720-e175-4720-b441-ead137211802-webhook-cert\") pod \"maas-controller-7d4df5c94-4pwpp\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") " pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:08.799105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.799067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-webhook-cert\") pod \"maas-controller-54c7c76bb-kh9ns\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") " pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.801592 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.801558    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-webhook-cert\") pod \"maas-controller-54c7c76bb-kh9ns\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") " pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:08.855644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.855595    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:09.000025 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:08.999989    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:09.043355 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:09.043330    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7d4df5c94-4pwpp"]
Jul 06 19:29:09.046102 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:29:09.046067    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3d3720_e175_4720_b441_ead137211802.slice/crio-3f5b460fdb34247ef086abe8533d78790a3a8376103764facfae31ebb8d84166 WatchSource:0}: Error finding container 3f5b460fdb34247ef086abe8533d78790a3a8376103764facfae31ebb8d84166: Status 404 returned error can't find the container with id 3f5b460fdb34247ef086abe8533d78790a3a8376103764facfae31ebb8d84166
Jul 06 19:29:09.146370 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:09.146217    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c7c76bb-kh9ns"]
Jul 06 19:29:09.148992 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:29:09.148963    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd66faef_2665_4ce6_bd36_8d13e7ce7e6d.slice/crio-6e64d42a3a3eab74fe8aeefacba42d3f5b8051729fa75b5fc073b44cc023f588 WatchSource:0}: Error finding container 6e64d42a3a3eab74fe8aeefacba42d3f5b8051729fa75b5fc073b44cc023f588: Status 404 returned error can't find the container with id 6e64d42a3a3eab74fe8aeefacba42d3f5b8051729fa75b5fc073b44cc023f588
Jul 06 19:29:09.253586 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:09.253494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c7c76bb-kh9ns" event={"ID":"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d","Type":"ContainerStarted","Data":"6e64d42a3a3eab74fe8aeefacba42d3f5b8051729fa75b5fc073b44cc023f588"}
Jul 06 19:29:09.254512 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:09.254487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4df5c94-4pwpp" event={"ID":"2e3d3720-e175-4720-b441-ead137211802","Type":"ContainerStarted","Data":"3f5b460fdb34247ef086abe8533d78790a3a8376103764facfae31ebb8d84166"}
Jul 06 19:29:11.270108 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:11.270039    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c7c76bb-kh9ns" event={"ID":"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d","Type":"ContainerStarted","Data":"89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f"}
Jul 06 19:29:11.270642 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:11.270147    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:11.271657 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:11.271626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4df5c94-4pwpp" event={"ID":"2e3d3720-e175-4720-b441-ead137211802","Type":"ContainerStarted","Data":"1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb"}
Jul 06 19:29:11.271841 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:11.271825    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:11.322670 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:11.322616    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54c7c76bb-kh9ns" podStartSLOduration=1.283997753 podStartE2EDuration="3.32260025s" totalImagesPullingTime="2.038602497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:11.293372221 +0000 UTC m=+555.665853975" watchObservedRunningTime="2026-07-06 19:29:11.32260025 +0000 UTC m=+555.695082043"
Jul 06 19:29:11.476525 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:11.476437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:11.617444 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:11.617407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:22.281799 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.281770    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:29:22.282168 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.281838    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:22.302305 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.302254    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7d4df5c94-4pwpp" podStartSLOduration=13.16856159 podStartE2EDuration="15.302239259s" totalImagesPullingTime="2.133677669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:11.321898029 +0000 UTC m=+555.694379761" watchObservedRunningTime="2026-07-06 19:29:22.302239259 +0000 UTC m=+566.674720991"
Jul 06 19:29:22.351836 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.351795    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d4df5c94-4pwpp"]
Jul 06 19:29:22.352016 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.351970    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7d4df5c94-4pwpp" podUID="2e3d3720-e175-4720-b441-ead137211802" containerName="manager" containerID="cri-o://1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb" gracePeriod=30
Jul 06 19:29:22.594142 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.594113    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:22.717189 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.717160    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e3d3720-e175-4720-b441-ead137211802-webhook-cert\") pod \"2e3d3720-e175-4720-b441-ead137211802\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") "
Jul 06 19:29:22.717358 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.717210    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3d3720-e175-4720-b441-ead137211802-service-ca\") pod \"2e3d3720-e175-4720-b441-ead137211802\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") "
Jul 06 19:29:22.717358 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.717261    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2llgq\" (UniqueName: \"kubernetes.io/projected/2e3d3720-e175-4720-b441-ead137211802-kube-api-access-2llgq\") pod \"2e3d3720-e175-4720-b441-ead137211802\" (UID: \"2e3d3720-e175-4720-b441-ead137211802\") "
Jul 06 19:29:22.717662 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.717635    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e3d3720-e175-4720-b441-ead137211802-service-ca" (OuterVolumeSpecName: "service-ca") pod "2e3d3720-e175-4720-b441-ead137211802" (UID: "2e3d3720-e175-4720-b441-ead137211802"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:29:22.719314 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.719292    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e3d3720-e175-4720-b441-ead137211802-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2e3d3720-e175-4720-b441-ead137211802" (UID: "2e3d3720-e175-4720-b441-ead137211802"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:29:22.719371 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.719346    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e3d3720-e175-4720-b441-ead137211802-kube-api-access-2llgq" (OuterVolumeSpecName: "kube-api-access-2llgq") pod "2e3d3720-e175-4720-b441-ead137211802" (UID: "2e3d3720-e175-4720-b441-ead137211802"). InnerVolumeSpecName "kube-api-access-2llgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:29:22.818068 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.818005    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e3d3720-e175-4720-b441-ead137211802-webhook-cert\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:29:22.818068 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.818052    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e3d3720-e175-4720-b441-ead137211802-service-ca\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:29:22.818068 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:22.818063    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2llgq\" (UniqueName: \"kubernetes.io/projected/2e3d3720-e175-4720-b441-ead137211802-kube-api-access-2llgq\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:29:23.328858 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:23.328820    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e3d3720-e175-4720-b441-ead137211802" containerID="1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb" exitCode=0
Jul 06 19:29:23.329282 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:23.328896    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7d4df5c94-4pwpp"
Jul 06 19:29:23.329282 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:23.328903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4df5c94-4pwpp" event={"ID":"2e3d3720-e175-4720-b441-ead137211802","Type":"ContainerDied","Data":"1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb"}
Jul 06 19:29:23.329282 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:23.328981    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7d4df5c94-4pwpp" event={"ID":"2e3d3720-e175-4720-b441-ead137211802","Type":"ContainerDied","Data":"3f5b460fdb34247ef086abe8533d78790a3a8376103764facfae31ebb8d84166"}
Jul 06 19:29:23.329282 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:23.329002    2579 scope.go:117] "RemoveContainer" containerID="1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb"
Jul 06 19:29:23.337559 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:23.337542    2579 scope.go:117] "RemoveContainer" containerID="1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb"
Jul 06 19:29:23.337841 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:29:23.337822    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb\": container with ID starting with 1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb not found: ID does not exist" containerID="1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb"
Jul 06 19:29:23.337895 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:23.337849    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb"} err="failed to get container status \"1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb\": rpc error: code = NotFound desc = could not find container \"1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb\": container with ID starting with 1b4664a233b64d97ab63485a1b54028e7a016e1a90b5dbcdb4744924f3d212eb not found: ID does not exist"
Jul 06 19:29:23.353337 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:23.353309    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7d4df5c94-4pwpp"]
Jul 06 19:29:23.361984 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:23.361961    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7d4df5c94-4pwpp"]
Jul 06 19:29:24.099689 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:24.099660    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e3d3720-e175-4720-b441-ead137211802" path="/var/lib/kubelet/pods/2e3d3720-e175-4720-b441-ead137211802/volumes"
Jul 06 19:29:29.677546 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:29.677499    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:45.073242 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.073201    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:45.510577 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.510544    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:45.601218 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.601181    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-69bfdfb78f-5wtns"]
Jul 06 19:29:45.601495 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.601482    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e3d3720-e175-4720-b441-ead137211802" containerName="manager"
Jul 06 19:29:45.601557 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.601495    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e3d3720-e175-4720-b441-ead137211802" containerName="manager"
Jul 06 19:29:45.601557 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.601548    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e3d3720-e175-4720-b441-ead137211802" containerName="manager"
Jul 06 19:29:45.607191 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.607167    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:45.610161 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.610140    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 06 19:29:45.610289 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.610187    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-8lvxq\""
Jul 06 19:29:45.617350 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.617329    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69bfdfb78f-5wtns"]
Jul 06 19:29:45.693521 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.693483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c8b678-2605-45bb-9c5c-92b90bc806e1-maas-api-tls\") pod \"maas-api-69bfdfb78f-5wtns\" (UID: \"54c8b678-2605-45bb-9c5c-92b90bc806e1\") " pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:45.693733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.693551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv7t6\" (UniqueName: \"kubernetes.io/projected/54c8b678-2605-45bb-9c5c-92b90bc806e1-kube-api-access-mv7t6\") pod \"maas-api-69bfdfb78f-5wtns\" (UID: \"54c8b678-2605-45bb-9c5c-92b90bc806e1\") " pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:45.693733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.693645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c8b678-2605-45bb-9c5c-92b90bc806e1-openshift-service-ca\") pod \"maas-api-69bfdfb78f-5wtns\" (UID: \"54c8b678-2605-45bb-9c5c-92b90bc806e1\") " pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:45.794632 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.794554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c8b678-2605-45bb-9c5c-92b90bc806e1-openshift-service-ca\") pod \"maas-api-69bfdfb78f-5wtns\" (UID: \"54c8b678-2605-45bb-9c5c-92b90bc806e1\") " pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:45.794632 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.794606    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c8b678-2605-45bb-9c5c-92b90bc806e1-maas-api-tls\") pod \"maas-api-69bfdfb78f-5wtns\" (UID: \"54c8b678-2605-45bb-9c5c-92b90bc806e1\") " pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:45.794841 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.794654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv7t6\" (UniqueName: \"kubernetes.io/projected/54c8b678-2605-45bb-9c5c-92b90bc806e1-kube-api-access-mv7t6\") pod \"maas-api-69bfdfb78f-5wtns\" (UID: \"54c8b678-2605-45bb-9c5c-92b90bc806e1\") " pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:45.794841 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:29:45.794782    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 06 19:29:45.794922 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:29:45.794859    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c8b678-2605-45bb-9c5c-92b90bc806e1-maas-api-tls podName:54c8b678-2605-45bb-9c5c-92b90bc806e1 nodeName:}" failed. No retries permitted until 2026-07-06 19:29:46.294838866 +0000 UTC m=+590.667320584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/54c8b678-2605-45bb-9c5c-92b90bc806e1-maas-api-tls") pod "maas-api-69bfdfb78f-5wtns" (UID: "54c8b678-2605-45bb-9c5c-92b90bc806e1") : secret "maas-api-serving-cert" not found
Jul 06 19:29:45.795185 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.795166    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54c8b678-2605-45bb-9c5c-92b90bc806e1-openshift-service-ca\") pod \"maas-api-69bfdfb78f-5wtns\" (UID: \"54c8b678-2605-45bb-9c5c-92b90bc806e1\") " pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:45.809462 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.809422    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv7t6\" (UniqueName: \"kubernetes.io/projected/54c8b678-2605-45bb-9c5c-92b90bc806e1-kube-api-access-mv7t6\") pod \"maas-api-69bfdfb78f-5wtns\" (UID: \"54c8b678-2605-45bb-9c5c-92b90bc806e1\") " pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:45.899941 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:45.899910    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:46.088876 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.088781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:46.195995 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.195962    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:29:46.295950 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.295911    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-tgnw4"]
Jul 06 19:29:46.299311 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.299291    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c8b678-2605-45bb-9c5c-92b90bc806e1-maas-api-tls\") pod \"maas-api-69bfdfb78f-5wtns\" (UID: \"54c8b678-2605-45bb-9c5c-92b90bc806e1\") " pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:46.299939 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.299913    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4"
Jul 06 19:29:46.301733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.301697    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54c8b678-2605-45bb-9c5c-92b90bc806e1-maas-api-tls\") pod \"maas-api-69bfdfb78f-5wtns\" (UID: \"54c8b678-2605-45bb-9c5c-92b90bc806e1\") " pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:46.307494 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.307477    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wxk2g\""
Jul 06 19:29:46.307861 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.307846    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 06 19:29:46.316838 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.316813    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-tgnw4"]
Jul 06 19:29:46.361575 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.361542    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qzzbp"]
Jul 06 19:29:46.365557 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.365541    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qzzbp"
Jul 06 19:29:46.375768 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.375736    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qzzbp"]
Jul 06 19:29:46.400312 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.400280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4-plugins-config-volume\") pod \"payload-processing-58f86c7798-qzzbp\" (UID: \"56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4\") " pod="openshift-ingress/payload-processing-58f86c7798-qzzbp"
Jul 06 19:29:46.400469 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.400316    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbhg4\" (UniqueName: \"kubernetes.io/projected/b8f637b5-a57d-4a52-b32b-a0c8e8f397dd-kube-api-access-vbhg4\") pod \"payload-pre-processing-7964457696-tgnw4\" (UID: \"b8f637b5-a57d-4a52-b32b-a0c8e8f397dd\") " pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4"
Jul 06 19:29:46.400469 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.400407    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbbvq\" (UniqueName: \"kubernetes.io/projected/56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4-kube-api-access-vbbvq\") pod \"payload-processing-58f86c7798-qzzbp\" (UID: \"56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4\") " pod="openshift-ingress/payload-processing-58f86c7798-qzzbp"
Jul 06 19:29:46.400469 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.400442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8f637b5-a57d-4a52-b32b-a0c8e8f397dd-plugins-config-volume\") pod \"payload-pre-processing-7964457696-tgnw4\" (UID: \"b8f637b5-a57d-4a52-b32b-a0c8e8f397dd\") " pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4"
Jul 06 19:29:46.501428 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.501398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbbvq\" (UniqueName: \"kubernetes.io/projected/56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4-kube-api-access-vbbvq\") pod \"payload-processing-58f86c7798-qzzbp\" (UID: \"56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4\") " pod="openshift-ingress/payload-processing-58f86c7798-qzzbp"
Jul 06 19:29:46.501595 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.501437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8f637b5-a57d-4a52-b32b-a0c8e8f397dd-plugins-config-volume\") pod \"payload-pre-processing-7964457696-tgnw4\" (UID: \"b8f637b5-a57d-4a52-b32b-a0c8e8f397dd\") " pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4"
Jul 06 19:29:46.501595 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.501493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4-plugins-config-volume\") pod \"payload-processing-58f86c7798-qzzbp\" (UID: \"56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4\") " pod="openshift-ingress/payload-processing-58f86c7798-qzzbp"
Jul 06 19:29:46.501595 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.501517    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhg4\" (UniqueName: \"kubernetes.io/projected/b8f637b5-a57d-4a52-b32b-a0c8e8f397dd-kube-api-access-vbhg4\") pod \"payload-pre-processing-7964457696-tgnw4\" (UID: \"b8f637b5-a57d-4a52-b32b-a0c8e8f397dd\") " pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4"
Jul 06 19:29:46.502212 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.502191    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4-plugins-config-volume\") pod \"payload-processing-58f86c7798-qzzbp\" (UID: \"56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4\") " pod="openshift-ingress/payload-processing-58f86c7798-qzzbp"
Jul 06 19:29:46.502308 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.502199    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b8f637b5-a57d-4a52-b32b-a0c8e8f397dd-plugins-config-volume\") pod \"payload-pre-processing-7964457696-tgnw4\" (UID: \"b8f637b5-a57d-4a52-b32b-a0c8e8f397dd\") " pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4"
Jul 06 19:29:46.513911 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.513882    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbbvq\" (UniqueName: \"kubernetes.io/projected/56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4-kube-api-access-vbbvq\") pod \"payload-processing-58f86c7798-qzzbp\" (UID: \"56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4\") " pod="openshift-ingress/payload-processing-58f86c7798-qzzbp"
Jul 06 19:29:46.514323 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.514306    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbhg4\" (UniqueName: \"kubernetes.io/projected/b8f637b5-a57d-4a52-b32b-a0c8e8f397dd-kube-api-access-vbhg4\") pod \"payload-pre-processing-7964457696-tgnw4\" (UID: \"b8f637b5-a57d-4a52-b32b-a0c8e8f397dd\") " pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4"
Jul 06 19:29:46.518162 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.518141    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:46.618807 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.618735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4"
Jul 06 19:29:46.672444 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.672291    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-69bfdfb78f-5wtns"]
Jul 06 19:29:46.675428 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:29:46.675403    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c8b678_2605_45bb_9c5c_92b90bc806e1.slice/crio-bf916a3a611ac927c2bb933c86ad440487d2cbc82ee520485ae910f2ea5d1936 WatchSource:0}: Error finding container bf916a3a611ac927c2bb933c86ad440487d2cbc82ee520485ae910f2ea5d1936: Status 404 returned error can't find the container with id bf916a3a611ac927c2bb933c86ad440487d2cbc82ee520485ae910f2ea5d1936
Jul 06 19:29:46.678680 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.678661    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-qzzbp"
Jul 06 19:29:46.758106 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.758084    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-tgnw4"]
Jul 06 19:29:46.760165 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:29:46.760137    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f637b5_a57d_4a52_b32b_a0c8e8f397dd.slice/crio-127e38540b0c43f979a0d783b7819945ff440ecfe033610805dc64be9904e790 WatchSource:0}: Error finding container 127e38540b0c43f979a0d783b7819945ff440ecfe033610805dc64be9904e790: Status 404 returned error can't find the container with id 127e38540b0c43f979a0d783b7819945ff440ecfe033610805dc64be9904e790
Jul 06 19:29:46.822240 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:46.822212    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-qzzbp"]
Jul 06 19:29:46.825025 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:29:46.824988    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e6e450_f2d8_4c51_b55d_bbbcfdac2cc4.slice/crio-ff67c13d6a93fb9cf196556954bc8395674047d7a8671f3bfa374ba1abf265a6 WatchSource:0}: Error finding container ff67c13d6a93fb9cf196556954bc8395674047d7a8671f3bfa374ba1abf265a6: Status 404 returned error can't find the container with id ff67c13d6a93fb9cf196556954bc8395674047d7a8671f3bfa374ba1abf265a6
Jul 06 19:29:47.431162 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:47.431085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qzzbp" event={"ID":"56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4","Type":"ContainerStarted","Data":"ff67c13d6a93fb9cf196556954bc8395674047d7a8671f3bfa374ba1abf265a6"}
Jul 06 19:29:47.433034 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:47.432999    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4" event={"ID":"b8f637b5-a57d-4a52-b32b-a0c8e8f397dd","Type":"ContainerStarted","Data":"127e38540b0c43f979a0d783b7819945ff440ecfe033610805dc64be9904e790"}
Jul 06 19:29:47.434608 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:47.434579    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69bfdfb78f-5wtns" event={"ID":"54c8b678-2605-45bb-9c5c-92b90bc806e1","Type":"ContainerStarted","Data":"bf916a3a611ac927c2bb933c86ad440487d2cbc82ee520485ae910f2ea5d1936"}
Jul 06 19:29:49.443816 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:49.443771    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-qzzbp" event={"ID":"56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4","Type":"ContainerStarted","Data":"a04f56ae16add331195e4e2dc400dc496444c01fe585ea14cd389a6d8c712c09"}
Jul 06 19:29:49.444285 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:49.443904    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-qzzbp"
Jul 06 19:29:49.445233 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:49.445212    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4" event={"ID":"b8f637b5-a57d-4a52-b32b-a0c8e8f397dd","Type":"ContainerStarted","Data":"9c2b6cb8f3d535130c6ae282f5cd0c6d2db1ea6eab9c79f06ffc02c25906f351"}
Jul 06 19:29:49.445351 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:49.445278    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4"
Jul 06 19:29:49.446565 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:49.446547    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-69bfdfb78f-5wtns" event={"ID":"54c8b678-2605-45bb-9c5c-92b90bc806e1","Type":"ContainerStarted","Data":"b21f783e12ed5921d01473c3f86407577ac81ab5bf755d52e135b7785379fe7a"}
Jul 06 19:29:49.446684 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:49.446670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:29:49.462551 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:49.462506    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-qzzbp" podStartSLOduration=1.814724966 podStartE2EDuration="3.46248778s" totalImagesPullingTime="1.647762814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:49.461855794 +0000 UTC m=+593.834337539" watchObservedRunningTime="2026-07-06 19:29:49.46248778 +0000 UTC m=+593.834969510"
Jul 06 19:29:49.479441 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:49.479390    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-69bfdfb78f-5wtns" podStartSLOduration=2.681859171 podStartE2EDuration="4.479374218s" totalImagesPullingTime="1.797515047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:49.479029357 +0000 UTC m=+593.851511100" watchObservedRunningTime="2026-07-06 19:29:49.479374218 +0000 UTC m=+593.851855950"
Jul 06 19:29:49.496071 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:49.496025    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4" podStartSLOduration=1.7811501079999998 podStartE2EDuration="3.496011374s" totalImagesPullingTime="1.714861266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:29:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:29:49.495187416 +0000 UTC m=+593.867669149" watchObservedRunningTime="2026-07-06 19:29:49.496011374 +0000 UTC m=+593.868493105"
Jul 06 19:29:55.457415 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:29:55.457390    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-69bfdfb78f-5wtns"
Jul 06 19:30:00.138068 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:00.138029    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-6n45d"]
Jul 06 19:30:00.141248 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:00.141233    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-6n45d"
Jul 06 19:30:00.150481 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:00.150452    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-6n45d"]
Jul 06 19:30:00.229435 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:00.229397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5pkt\" (UniqueName: \"kubernetes.io/projected/cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac-kube-api-access-l5pkt\") pod \"maas-api-key-cleanup-29722770-6n45d\" (UID: \"cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac\") " pod="opendatahub/maas-api-key-cleanup-29722770-6n45d"
Jul 06 19:30:00.330450 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:00.330406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5pkt\" (UniqueName: \"kubernetes.io/projected/cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac-kube-api-access-l5pkt\") pod \"maas-api-key-cleanup-29722770-6n45d\" (UID: \"cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac\") " pod="opendatahub/maas-api-key-cleanup-29722770-6n45d"
Jul 06 19:30:00.339813 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:00.339779    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5pkt\" (UniqueName: \"kubernetes.io/projected/cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac-kube-api-access-l5pkt\") pod \"maas-api-key-cleanup-29722770-6n45d\" (UID: \"cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac\") " pod="opendatahub/maas-api-key-cleanup-29722770-6n45d"
Jul 06 19:30:00.451917 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:00.451822    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-6n45d"
Jul 06 19:30:00.453196 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:00.453173    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-tgnw4"
Jul 06 19:30:00.453451 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:00.453431    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-qzzbp"
Jul 06 19:30:00.597389 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:00.597369    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722770-6n45d"]
Jul 06 19:30:00.599985 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:30:00.599955    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2e1ce3_ea0f_44b3_abfc_039d80ee50ac.slice/crio-26672119820df0aa92e114ac83226be8124685baf86391eccdb2b002f6d894d3 WatchSource:0}: Error finding container 26672119820df0aa92e114ac83226be8124685baf86391eccdb2b002f6d894d3: Status 404 returned error can't find the container with id 26672119820df0aa92e114ac83226be8124685baf86391eccdb2b002f6d894d3
Jul 06 19:30:01.499436 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:01.499401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-6n45d" event={"ID":"cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac","Type":"ContainerStarted","Data":"26672119820df0aa92e114ac83226be8124685baf86391eccdb2b002f6d894d3"}
Jul 06 19:30:06.522603 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:06.522510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-6n45d" event={"ID":"cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac","Type":"ContainerStarted","Data":"959e60f527fbd502403f699ab2a574c3b5e512877ab4b2b3133312c47dc19c2f"}
Jul 06 19:30:06.543430 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:06.543376    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722770-6n45d" podStartSLOduration=1.130624099 podStartE2EDuration="6.543360955s" totalImagesPullingTime="5.412736856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:06.54184659 +0000 UTC m=+610.914328325" watchObservedRunningTime="2026-07-06 19:30:06.543360955 +0000 UTC m=+610.915842686"
Jul 06 19:30:07.529766 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:07.529730    2579 generic.go:356] "Generic (PLEG): container finished" podID="cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac" containerID="959e60f527fbd502403f699ab2a574c3b5e512877ab4b2b3133312c47dc19c2f" exitCode=0
Jul 06 19:30:07.530177 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:07.529798    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-6n45d" event={"ID":"cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac","Type":"ContainerDied","Data":"959e60f527fbd502403f699ab2a574c3b5e512877ab4b2b3133312c47dc19c2f"}
Jul 06 19:30:07.544688 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:07.544659    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:08.682063 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:08.682033    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-6n45d"
Jul 06 19:30:08.806367 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:08.806273    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5pkt\" (UniqueName: \"kubernetes.io/projected/cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac-kube-api-access-l5pkt\") pod \"cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac\" (UID: \"cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac\") "
Jul 06 19:30:08.808393 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:08.808365    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac-kube-api-access-l5pkt" (OuterVolumeSpecName: "kube-api-access-l5pkt") pod "cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac" (UID: "cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac"). InnerVolumeSpecName "kube-api-access-l5pkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:30:08.907597 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:08.907566    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5pkt\" (UniqueName: \"kubernetes.io/projected/cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac-kube-api-access-l5pkt\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:30:09.209716 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:09.209677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:09.539275 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:09.539191    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722770-6n45d"
Jul 06 19:30:09.539275 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:09.539225    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722770-6n45d" event={"ID":"cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac","Type":"ContainerDied","Data":"26672119820df0aa92e114ac83226be8124685baf86391eccdb2b002f6d894d3"}
Jul 06 19:30:09.539275 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:09.539264    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26672119820df0aa92e114ac83226be8124685baf86391eccdb2b002f6d894d3"
Jul 06 19:30:17.582843 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:17.582731    2579 generic.go:356] "Generic (PLEG): container finished" podID="6cd1f295-3fcb-437c-97d7-be47b0fd14d3" containerID="54f10c76e413f20ce52b67f46f18e6c840b2133ea8c6bac77861f44326731dfd" exitCode=0
Jul 06 19:30:17.582843 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:17.582791    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp" event={"ID":"6cd1f295-3fcb-437c-97d7-be47b0fd14d3","Type":"ContainerDied","Data":"54f10c76e413f20ce52b67f46f18e6c840b2133ea8c6bac77861f44326731dfd"}
Jul 06 19:30:17.583278 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:17.583257    2579 scope.go:117] "RemoveContainer" containerID="54f10c76e413f20ce52b67f46f18e6c840b2133ea8c6bac77861f44326731dfd"
Jul 06 19:30:17.584324 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:17.584297    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:17.584379 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:17.584361    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:17.584533 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:17.584388    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:30:18.589135 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:18.589101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp" event={"ID":"6cd1f295-3fcb-437c-97d7-be47b0fd14d3","Type":"ContainerStarted","Data":"5f5ac2e60fec02a74b68cc1202dfc1b322c3972bc62bc4876c70725bdc5f4518"}
Jul 06 19:30:19.060341 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:19.060297    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:30:19.060578 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:19.060549    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4bpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 06 19:30:19.060787 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:19.060752    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp" podUID="6cd1f295-3fcb-437c-97d7-be47b0fd14d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 06 19:30:20.060656 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:20.060616    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4bpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 06 19:30:20.061273 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:20.061242    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp" podUID="6cd1f295-3fcb-437c-97d7-be47b0fd14d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 06 19:30:21.061111 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:21.061071    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4bpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 06 19:30:21.061742 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:21.061688    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp" podUID="6cd1f295-3fcb-437c-97d7-be47b0fd14d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 06 19:30:22.060659 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:22.060613    2579 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-b4bpp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 06 19:30:22.060903 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:22.060719    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp" podUID="6cd1f295-3fcb-437c-97d7-be47b0fd14d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 06 19:30:23.064236 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:23.064206    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:30:23.064644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:23.064573    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:30:23.065199 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:23.065182    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-b4bpp"
Jul 06 19:30:33.834922 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.834891    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"]
Jul 06 19:30:33.835315 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.835237    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac" containerName="cleanup"
Jul 06 19:30:33.835315 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.835248    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac" containerName="cleanup"
Jul 06 19:30:33.835315 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.835303    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac" containerName="cleanup"
Jul 06 19:30:33.842998 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.842975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:33.846229 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.846209    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 19:30:33.847145 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.847121    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-msnlq\""
Jul 06 19:30:33.847261 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.847125    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 19:30:33.847261 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.847155    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 19:30:33.856756 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.856730    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"]
Jul 06 19:30:33.925694 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.925655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmmk4\" (UniqueName: \"kubernetes.io/projected/46ce160c-1879-43ad-b0f6-d350c8feb8af-kube-api-access-xmmk4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:33.925886 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.925742    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:33.925886 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.925772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46ce160c-1879-43ad-b0f6-d350c8feb8af-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:33.925886 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.925792    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:33.925886 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.925807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:33.926039 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.925897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:33.945387 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:33.945353    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:34.026836 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.026795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.027028 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.026895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmmk4\" (UniqueName: \"kubernetes.io/projected/46ce160c-1879-43ad-b0f6-d350c8feb8af-kube-api-access-xmmk4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.027028 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.026946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.027028 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.026982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46ce160c-1879-43ad-b0f6-d350c8feb8af-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.027028 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.027013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.027217 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.027032    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.027284 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.027261    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.027375 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.027354    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.027435 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.027372    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.029372 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.029349    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46ce160c-1879-43ad-b0f6-d350c8feb8af-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.029657 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.029642    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46ce160c-1879-43ad-b0f6-d350c8feb8af-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.038497 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.038472    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmmk4\" (UniqueName: \"kubernetes.io/projected/46ce160c-1879-43ad-b0f6-d350c8feb8af-kube-api-access-xmmk4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh\" (UID: \"46ce160c-1879-43ad-b0f6-d350c8feb8af\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.153732 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.153667    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:34.317411 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.317378    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"]
Jul 06 19:30:34.321050 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:30:34.321016    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ce160c_1879_43ad_b0f6_d350c8feb8af.slice/crio-93b2ab451f5fbeb64d7da22fb88b2d69f51e36a4c6052eee9200807fd10f11c8 WatchSource:0}: Error finding container 93b2ab451f5fbeb64d7da22fb88b2d69f51e36a4c6052eee9200807fd10f11c8: Status 404 returned error can't find the container with id 93b2ab451f5fbeb64d7da22fb88b2d69f51e36a4c6052eee9200807fd10f11c8
Jul 06 19:30:34.322287 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.322272    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:30:34.662291 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:34.662252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh" event={"ID":"46ce160c-1879-43ad-b0f6-d350c8feb8af","Type":"ContainerStarted","Data":"93b2ab451f5fbeb64d7da22fb88b2d69f51e36a4c6052eee9200807fd10f11c8"}
Jul 06 19:30:35.667778 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:35.667744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh" event={"ID":"46ce160c-1879-43ad-b0f6-d350c8feb8af","Type":"ContainerStarted","Data":"7a5a49b5f1b34c7710a050ba115c595c61d87aadc912ee3561c825a6e799ff7f"}
Jul 06 19:30:35.693796 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:35.693733    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh" podStartSLOduration=1.512955891 podStartE2EDuration="2.693693589s" totalImagesPullingTime="1.180737698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:35.690440771 +0000 UTC m=+640.062922531" watchObservedRunningTime="2026-07-06 19:30:35.693693589 +0000 UTC m=+640.066175322"
Jul 06 19:30:43.635966 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.635934    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"]
Jul 06 19:30:43.639423 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.639406    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.642007 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.641988    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 06 19:30:43.653037 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.653012    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"]
Jul 06 19:30:43.693319 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.693286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:43.710497 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.710465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.710655 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.710499    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljh8t\" (UniqueName: \"kubernetes.io/projected/09f9bc2e-c3f5-4170-86e0-a7500343445c-kube-api-access-ljh8t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.710655 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.710622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.710813 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.710665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.710813 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.710756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09f9bc2e-c3f5-4170-86e0-a7500343445c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.710813 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.710791    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.811969 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.811918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.811969 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.811976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljh8t\" (UniqueName: \"kubernetes.io/projected/09f9bc2e-c3f5-4170-86e0-a7500343445c-kube-api-access-ljh8t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.812222 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.812020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.812222 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.812049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.812222 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.812092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09f9bc2e-c3f5-4170-86e0-a7500343445c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.812222 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.812125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.812407 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.812300    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.812469 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.812452    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.812547 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.812527    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.814439 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.814412    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/09f9bc2e-c3f5-4170-86e0-a7500343445c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.814599 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.814576    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/09f9bc2e-c3f5-4170-86e0-a7500343445c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.820369 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.820347    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljh8t\" (UniqueName: \"kubernetes.io/projected/09f9bc2e-c3f5-4170-86e0-a7500343445c-kube-api-access-ljh8t\") pod \"e2e-distinct-simulated-kserve-59975d69f9-22x4d\" (UID: \"09f9bc2e-c3f5-4170-86e0-a7500343445c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:43.950013 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:43.949914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:44.103025 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:30:44.102994    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f9bc2e_c3f5_4170_86e0_a7500343445c.slice/crio-52e060f9d14f5e4ca6affba4cb1e200dcb704830a4cbbd1990fa7c4cf60d060d WatchSource:0}: Error finding container 52e060f9d14f5e4ca6affba4cb1e200dcb704830a4cbbd1990fa7c4cf60d060d: Status 404 returned error can't find the container with id 52e060f9d14f5e4ca6affba4cb1e200dcb704830a4cbbd1990fa7c4cf60d060d
Jul 06 19:30:44.103804 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:44.103777    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"]
Jul 06 19:30:44.154760 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:44.154695    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:44.154922 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:44.154777    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:44.166998 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:44.166976    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:44.711536 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:44.711501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d" event={"ID":"09f9bc2e-c3f5-4170-86e0-a7500343445c","Type":"ContainerStarted","Data":"9164ddfc349ecc9a2fc8ee7ed9f23c4a2421faba01ebd24dec46f6061466f2eb"}
Jul 06 19:30:44.711971 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:44.711554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d" event={"ID":"09f9bc2e-c3f5-4170-86e0-a7500343445c","Type":"ContainerStarted","Data":"52e060f9d14f5e4ca6affba4cb1e200dcb704830a4cbbd1990fa7c4cf60d060d"}
Jul 06 19:30:44.722778 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:44.722754    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh"
Jul 06 19:30:44.734812 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:44.734767    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d" podStartSLOduration=1.528748918 podStartE2EDuration="1.734752875s" totalImagesPullingTime="206.003957ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:30:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:30:44.733306608 +0000 UTC m=+649.105788352" watchObservedRunningTime="2026-07-06 19:30:44.734752875 +0000 UTC m=+649.107234607"
Jul 06 19:30:49.298903 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:49.298856    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:30:53.950634 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:53.950598    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:53.951080 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:53.950969    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:53.963019 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:53.962996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:54.765380 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:54.765345    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-22x4d"
Jul 06 19:30:55.103864 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:30:55.103825    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:06.438643 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:06.438020    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:13.816154 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:13.816118    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:30.679401 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.679369    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"]
Jul 06 19:31:30.682754 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.682733    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.686576 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.686537    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 19:31:30.711127 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.711102    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"]
Jul 06 19:31:30.724328 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.724300    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2vt4\" (UniqueName: \"kubernetes.io/projected/7c310a30-bd5a-4649-9b11-199c23002986-kube-api-access-k2vt4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.724451 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.724337    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.724451 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.724418    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.724451 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.724435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.724451 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.724449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c310a30-bd5a-4649-9b11-199c23002986-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.724589 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.724541    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.824978 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.824940    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.824978 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.824976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.825219 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.825001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c310a30-bd5a-4649-9b11-199c23002986-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.825219 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.825047    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.825219 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.825083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2vt4\" (UniqueName: \"kubernetes.io/projected/7c310a30-bd5a-4649-9b11-199c23002986-kube-api-access-k2vt4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.825219 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.825112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.825421 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.825355    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.825516 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.825492    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.825579 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.825517    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.827307 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.827284    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c310a30-bd5a-4649-9b11-199c23002986-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.827581 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.827561    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c310a30-bd5a-4649-9b11-199c23002986-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.830879 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.830854    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:30.840607 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.840582    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2vt4\" (UniqueName: \"kubernetes.io/projected/7c310a30-bd5a-4649-9b11-199c23002986-kube-api-access-k2vt4\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-bbnps\" (UID: \"7c310a30-bd5a-4649-9b11-199c23002986\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:30.995546 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:30.995452    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:31.186311 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:31.186279    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"]
Jul 06 19:31:31.192791 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:31:31.192764    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c310a30_bd5a_4649_9b11_199c23002986.slice/crio-5aa08880f555c188e6047ec174f4e765e1318da4b8771587a136668037dc6832 WatchSource:0}: Error finding container 5aa08880f555c188e6047ec174f4e765e1318da4b8771587a136668037dc6832: Status 404 returned error can't find the container with id 5aa08880f555c188e6047ec174f4e765e1318da4b8771587a136668037dc6832
Jul 06 19:31:31.924393 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:31.924357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps" event={"ID":"7c310a30-bd5a-4649-9b11-199c23002986","Type":"ContainerStarted","Data":"fa5b01b7b324305fd692c2154f03120c42c1c7b582becc05a38e49fb666c40fb"}
Jul 06 19:31:31.924781 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:31.924420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps" event={"ID":"7c310a30-bd5a-4649-9b11-199c23002986","Type":"ContainerStarted","Data":"5aa08880f555c188e6047ec174f4e765e1318da4b8771587a136668037dc6832"}
Jul 06 19:31:31.971809 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:31.971759    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps" podStartSLOduration=1.788407529 podStartE2EDuration="1.971742204s" totalImagesPullingTime="183.334675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:31.964366259 +0000 UTC m=+696.336847990" watchObservedRunningTime="2026-07-06 19:31:31.971742204 +0000 UTC m=+696.344223935"
Jul 06 19:31:37.542390 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:37.542352    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:37.661614 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:37.661575    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:39.085791 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.085754    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"]
Jul 06 19:31:39.089215 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.089198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.092601 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.092568    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 19:31:39.111015 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.110986    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"]
Jul 06 19:31:39.130443 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.130411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:31:39.208639 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.208601    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.208843 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.208676    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.208843 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.208732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1024fa76-eb50-4e6b-b556-921220e4fbd9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.208843 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.208767    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.208843 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.208804    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.209033 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.208890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smv9q\" (UniqueName: \"kubernetes.io/projected/1024fa76-eb50-4e6b-b556-921220e4fbd9-kube-api-access-smv9q\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.310012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.309976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smv9q\" (UniqueName: \"kubernetes.io/projected/1024fa76-eb50-4e6b-b556-921220e4fbd9-kube-api-access-smv9q\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.310213 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.310019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.310213 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.310055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.310213 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.310073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1024fa76-eb50-4e6b-b556-921220e4fbd9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.310213 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.310095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.310213 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.310120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.310550 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.310524    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.310664 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.310580    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.310664 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.310610    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.312467 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.312447    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1024fa76-eb50-4e6b-b556-921220e4fbd9-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.312633 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.312618    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1024fa76-eb50-4e6b-b556-921220e4fbd9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.319430 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.319404    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smv9q\" (UniqueName: \"kubernetes.io/projected/1024fa76-eb50-4e6b-b556-921220e4fbd9-kube-api-access-smv9q\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn\" (UID: \"1024fa76-eb50-4e6b-b556-921220e4fbd9\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.398840 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.398802    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:39.566454 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.566425    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"]
Jul 06 19:31:39.570399 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:31:39.570366    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1024fa76_eb50_4e6b_b556_921220e4fbd9.slice/crio-ae74731471b47635a135461f0c3d8ed9cb7c58e8fa116aff3b0d8341a234dc68 WatchSource:0}: Error finding container ae74731471b47635a135461f0c3d8ed9cb7c58e8fa116aff3b0d8341a234dc68: Status 404 returned error can't find the container with id ae74731471b47635a135461f0c3d8ed9cb7c58e8fa116aff3b0d8341a234dc68
Jul 06 19:31:39.962759 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.962696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn" event={"ID":"1024fa76-eb50-4e6b-b556-921220e4fbd9","Type":"ContainerStarted","Data":"a03bcbc3a839c68877813ff33ee8665a1559d98a2001af8b600b93bf5dc15b00"}
Jul 06 19:31:39.962759 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.962764    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn" event={"ID":"1024fa76-eb50-4e6b-b556-921220e4fbd9","Type":"ContainerStarted","Data":"ae74731471b47635a135461f0c3d8ed9cb7c58e8fa116aff3b0d8341a234dc68"}
Jul 06 19:31:39.992268 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:39.992208    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn" podStartSLOduration=0.791052179 podStartE2EDuration="992.190606ms" totalImagesPullingTime="201.138427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:31:39.990284869 +0000 UTC m=+704.362766603" watchObservedRunningTime="2026-07-06 19:31:39.992190606 +0000 UTC m=+704.364672358"
Jul 06 19:31:40.995834 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:40.995799    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:40.996302 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:40.995861    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:41.008303 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:41.008280    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:41.983426 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:41.983394    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-bbnps"
Jul 06 19:31:49.399617 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:49.399524    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:49.399617 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:49.399613    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:49.412258 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:49.412239    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:31:50.018418 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:31:50.018389    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn"
Jul 06 19:32:04.414942 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:32:04.414906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:14.074864 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:32:14.074827    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:14.171081 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:32:14.171048    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:15.244846 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:32:15.244815    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:32:15.445864 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:32:15.445827    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:25.637237 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:25.637138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:25.761154 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:25.761122    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54c7c76bb-kh9ns"]
Jul 06 19:33:25.761351 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:25.761324    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-54c7c76bb-kh9ns" podUID="fd66faef-2665-4ce6-bd36-8d13e7ce7e6d" containerName="manager" containerID="cri-o://89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f" gracePeriod=30
Jul 06 19:33:26.009085 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.009062    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:33:26.086986 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.086951    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdxq8\" (UniqueName: \"kubernetes.io/projected/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-kube-api-access-tdxq8\") pod \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") "
Jul 06 19:33:26.087147 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.087018    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-service-ca\") pod \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") "
Jul 06 19:33:26.087372 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.087349    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd66faef-2665-4ce6-bd36-8d13e7ce7e6d" (UID: "fd66faef-2665-4ce6-bd36-8d13e7ce7e6d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:33:26.089101 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.089076    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-kube-api-access-tdxq8" (OuterVolumeSpecName: "kube-api-access-tdxq8") pod "fd66faef-2665-4ce6-bd36-8d13e7ce7e6d" (UID: "fd66faef-2665-4ce6-bd36-8d13e7ce7e6d"). InnerVolumeSpecName "kube-api-access-tdxq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:33:26.188072 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.187977    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-webhook-cert\") pod \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\" (UID: \"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d\") "
Jul 06 19:33:26.188217 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.188150    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdxq8\" (UniqueName: \"kubernetes.io/projected/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-kube-api-access-tdxq8\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:33:26.188217 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.188163    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-service-ca\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:33:26.190024 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.190001    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "fd66faef-2665-4ce6-bd36-8d13e7ce7e6d" (UID: "fd66faef-2665-4ce6-bd36-8d13e7ce7e6d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:33:26.289124 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.289084    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d-webhook-cert\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:33:26.443634 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.443536    2579 generic.go:356] "Generic (PLEG): container finished" podID="fd66faef-2665-4ce6-bd36-8d13e7ce7e6d" containerID="89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f" exitCode=0
Jul 06 19:33:26.443634 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.443590    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c7c76bb-kh9ns"
Jul 06 19:33:26.443839 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.443635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c7c76bb-kh9ns" event={"ID":"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d","Type":"ContainerDied","Data":"89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f"}
Jul 06 19:33:26.443839 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.443686    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c7c76bb-kh9ns" event={"ID":"fd66faef-2665-4ce6-bd36-8d13e7ce7e6d","Type":"ContainerDied","Data":"6e64d42a3a3eab74fe8aeefacba42d3f5b8051729fa75b5fc073b44cc023f588"}
Jul 06 19:33:26.443839 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.443736    2579 scope.go:117] "RemoveContainer" containerID="89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f"
Jul 06 19:33:26.457238 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.457218    2579 scope.go:117] "RemoveContainer" containerID="89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f"
Jul 06 19:33:26.457515 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:33:26.457495    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f\": container with ID starting with 89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f not found: ID does not exist" containerID="89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f"
Jul 06 19:33:26.457580 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.457522    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f"} err="failed to get container status \"89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f\": rpc error: code = NotFound desc = could not find container \"89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f\": container with ID starting with 89cf96b9457c3e47759c8b9a5285fa00c37bd26800445fde039b6b28ecf2de0f not found: ID does not exist"
Jul 06 19:33:26.469270 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.469241    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54c7c76bb-kh9ns"]
Jul 06 19:33:26.473451 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:26.473419    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54c7c76bb-kh9ns"]
Jul 06 19:33:27.109725 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.109679    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:33:27.219262 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.219228    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54c7c76bb-q2qsg"]
Jul 06 19:33:27.219572 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.219560    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd66faef-2665-4ce6-bd36-8d13e7ce7e6d" containerName="manager"
Jul 06 19:33:27.219616 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.219574    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd66faef-2665-4ce6-bd36-8d13e7ce7e6d" containerName="manager"
Jul 06 19:33:27.219662 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.219657    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd66faef-2665-4ce6-bd36-8d13e7ce7e6d" containerName="manager"
Jul 06 19:33:27.223914 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.223897    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.226207 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.226181    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 06 19:33:27.226334 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.226242    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 06 19:33:27.227152 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.227133    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-c8ljl\""
Jul 06 19:33:27.231604 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.231582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c7c76bb-q2qsg"]
Jul 06 19:33:27.295380 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.295342    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdrx5\" (UniqueName: \"kubernetes.io/projected/0fa3021b-f200-409f-870b-50c0bde5ead4-kube-api-access-kdrx5\") pod \"maas-controller-54c7c76bb-q2qsg\" (UID: \"0fa3021b-f200-409f-870b-50c0bde5ead4\") " pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.295380 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.295380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa3021b-f200-409f-870b-50c0bde5ead4-service-ca\") pod \"maas-controller-54c7c76bb-q2qsg\" (UID: \"0fa3021b-f200-409f-870b-50c0bde5ead4\") " pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.295608 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.295419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fa3021b-f200-409f-870b-50c0bde5ead4-webhook-cert\") pod \"maas-controller-54c7c76bb-q2qsg\" (UID: \"0fa3021b-f200-409f-870b-50c0bde5ead4\") " pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.396519 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.396425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdrx5\" (UniqueName: \"kubernetes.io/projected/0fa3021b-f200-409f-870b-50c0bde5ead4-kube-api-access-kdrx5\") pod \"maas-controller-54c7c76bb-q2qsg\" (UID: \"0fa3021b-f200-409f-870b-50c0bde5ead4\") " pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.396519 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.396463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa3021b-f200-409f-870b-50c0bde5ead4-service-ca\") pod \"maas-controller-54c7c76bb-q2qsg\" (UID: \"0fa3021b-f200-409f-870b-50c0bde5ead4\") " pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.396806 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.396590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fa3021b-f200-409f-870b-50c0bde5ead4-webhook-cert\") pod \"maas-controller-54c7c76bb-q2qsg\" (UID: \"0fa3021b-f200-409f-870b-50c0bde5ead4\") " pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.397308 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.397289    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0fa3021b-f200-409f-870b-50c0bde5ead4-service-ca\") pod \"maas-controller-54c7c76bb-q2qsg\" (UID: \"0fa3021b-f200-409f-870b-50c0bde5ead4\") " pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.399116 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.399095    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fa3021b-f200-409f-870b-50c0bde5ead4-webhook-cert\") pod \"maas-controller-54c7c76bb-q2qsg\" (UID: \"0fa3021b-f200-409f-870b-50c0bde5ead4\") " pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.406283 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.406258    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdrx5\" (UniqueName: \"kubernetes.io/projected/0fa3021b-f200-409f-870b-50c0bde5ead4-kube-api-access-kdrx5\") pod \"maas-controller-54c7c76bb-q2qsg\" (UID: \"0fa3021b-f200-409f-870b-50c0bde5ead4\") " pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.534307 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.534273    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:27.670827 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:27.670801    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54c7c76bb-q2qsg"]
Jul 06 19:33:27.672947 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:33:27.672922    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa3021b_f200_409f_870b_50c0bde5ead4.slice/crio-ae3f2b8cfd26a8e686a51e51166160e45559a4151b7e74fe00d174a2bd0403da WatchSource:0}: Error finding container ae3f2b8cfd26a8e686a51e51166160e45559a4151b7e74fe00d174a2bd0403da: Status 404 returned error can't find the container with id ae3f2b8cfd26a8e686a51e51166160e45559a4151b7e74fe00d174a2bd0403da
Jul 06 19:33:28.100131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:28.100101    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd66faef-2665-4ce6-bd36-8d13e7ce7e6d" path="/var/lib/kubelet/pods/fd66faef-2665-4ce6-bd36-8d13e7ce7e6d/volumes"
Jul 06 19:33:28.454102 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:28.454015    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c7c76bb-q2qsg" event={"ID":"0fa3021b-f200-409f-870b-50c0bde5ead4","Type":"ContainerStarted","Data":"34bbb7384c3fed37c5239f9e2fbc82dc9d3cb995ee69e2d6be50b5137517c218"}
Jul 06 19:33:28.454102 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:28.454070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54c7c76bb-q2qsg" event={"ID":"0fa3021b-f200-409f-870b-50c0bde5ead4","Type":"ContainerStarted","Data":"ae3f2b8cfd26a8e686a51e51166160e45559a4151b7e74fe00d174a2bd0403da"}
Jul 06 19:33:28.454489 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:28.454150    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:33:28.485320 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:28.485270    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54c7c76bb-q2qsg" podStartSLOduration=1.034810679 podStartE2EDuration="1.485253871s" totalImagesPullingTime="450.443192ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:33:28.484940668 +0000 UTC m=+812.857422403" watchObservedRunningTime="2026-07-06 19:33:28.485253871 +0000 UTC m=+812.857735602"
Jul 06 19:33:39.466008 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:33:39.465976    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54c7c76bb-q2qsg"
Jul 06 19:34:06.213258 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:06.213218    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:06.313225 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:06.313166    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:06.412105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:06.412072    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:12.091749 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:12.091695    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:12.211165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:12.211129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:12.319464 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:12.319433    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:12.449454 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:12.449415    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:18.169529 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:18.169459    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:18.271100 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:18.271064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:43.212829 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:43.212787    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:55.023768 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:55.023665    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:34:55.125546 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:34:55.125507    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:35:56.673733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:35:56.673682    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:10.648396 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:37:10.648357    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:37:10.749054 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:37:10.749015    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:40:34.477745 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:40:34.477695    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:42:48.750913 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:42:48.750834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:22.399759 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:43:22.399724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:43:22.468979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:43:22.468945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:44:15.103329 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:44:15.103239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:45:00.193487 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:00.193451    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-ln79q"]
Jul 06 19:45:00.196797 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:00.196780    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-ln79q"
Jul 06 19:45:00.243736 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:00.243673    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-ln79q"]
Jul 06 19:45:00.291212 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:00.291172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2zbx\" (UniqueName: \"kubernetes.io/projected/1957345a-0d0f-4461-b505-cf9fab8e40f2-kube-api-access-v2zbx\") pod \"maas-api-key-cleanup-29722785-ln79q\" (UID: \"1957345a-0d0f-4461-b505-cf9fab8e40f2\") " pod="opendatahub/maas-api-key-cleanup-29722785-ln79q"
Jul 06 19:45:00.392289 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:00.392257    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2zbx\" (UniqueName: \"kubernetes.io/projected/1957345a-0d0f-4461-b505-cf9fab8e40f2-kube-api-access-v2zbx\") pod \"maas-api-key-cleanup-29722785-ln79q\" (UID: \"1957345a-0d0f-4461-b505-cf9fab8e40f2\") " pod="opendatahub/maas-api-key-cleanup-29722785-ln79q"
Jul 06 19:45:00.402128 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:00.402094    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2zbx\" (UniqueName: \"kubernetes.io/projected/1957345a-0d0f-4461-b505-cf9fab8e40f2-kube-api-access-v2zbx\") pod \"maas-api-key-cleanup-29722785-ln79q\" (UID: \"1957345a-0d0f-4461-b505-cf9fab8e40f2\") " pod="opendatahub/maas-api-key-cleanup-29722785-ln79q"
Jul 06 19:45:00.506849 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:00.506767    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-ln79q"
Jul 06 19:45:00.850981 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:00.850956    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722785-ln79q"]
Jul 06 19:45:00.852860 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:45:00.852826    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1957345a_0d0f_4461_b505_cf9fab8e40f2.slice/crio-dd8d1a25d3357e61dff1967eb35e52db734b487264fd3f7cdd85bc1134acf356 WatchSource:0}: Error finding container dd8d1a25d3357e61dff1967eb35e52db734b487264fd3f7cdd85bc1134acf356: Status 404 returned error can't find the container with id dd8d1a25d3357e61dff1967eb35e52db734b487264fd3f7cdd85bc1134acf356
Jul 06 19:45:01.631306 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:01.631274    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-ln79q" event={"ID":"1957345a-0d0f-4461-b505-cf9fab8e40f2","Type":"ContainerStarted","Data":"31d8531ebe0f2cc12385c93d307469f6c180d64f66463fd7399efbcf9c07c4bb"}
Jul 06 19:45:01.631695 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:01.631322    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-ln79q" event={"ID":"1957345a-0d0f-4461-b505-cf9fab8e40f2","Type":"ContainerStarted","Data":"dd8d1a25d3357e61dff1967eb35e52db734b487264fd3f7cdd85bc1134acf356"}
Jul 06 19:45:01.652131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:01.652079    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722785-ln79q" podStartSLOduration=1.65206192 podStartE2EDuration="1.65206192s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:45:01.650218302 +0000 UTC m=+1506.022700060" watchObservedRunningTime="2026-07-06 19:45:01.65206192 +0000 UTC m=+1506.024543651"
Jul 06 19:45:02.637581 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:02.637546    2579 generic.go:356] "Generic (PLEG): container finished" podID="1957345a-0d0f-4461-b505-cf9fab8e40f2" containerID="31d8531ebe0f2cc12385c93d307469f6c180d64f66463fd7399efbcf9c07c4bb" exitCode=0
Jul 06 19:45:02.637981 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:02.637612    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-ln79q" event={"ID":"1957345a-0d0f-4461-b505-cf9fab8e40f2","Type":"ContainerDied","Data":"31d8531ebe0f2cc12385c93d307469f6c180d64f66463fd7399efbcf9c07c4bb"}
Jul 06 19:45:03.768495 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:03.768472    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-ln79q"
Jul 06 19:45:03.824814 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:03.824777    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2zbx\" (UniqueName: \"kubernetes.io/projected/1957345a-0d0f-4461-b505-cf9fab8e40f2-kube-api-access-v2zbx\") pod \"1957345a-0d0f-4461-b505-cf9fab8e40f2\" (UID: \"1957345a-0d0f-4461-b505-cf9fab8e40f2\") "
Jul 06 19:45:03.826928 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:03.826897    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1957345a-0d0f-4461-b505-cf9fab8e40f2-kube-api-access-v2zbx" (OuterVolumeSpecName: "kube-api-access-v2zbx") pod "1957345a-0d0f-4461-b505-cf9fab8e40f2" (UID: "1957345a-0d0f-4461-b505-cf9fab8e40f2"). InnerVolumeSpecName "kube-api-access-v2zbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:45:03.925961 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:03.925861    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2zbx\" (UniqueName: \"kubernetes.io/projected/1957345a-0d0f-4461-b505-cf9fab8e40f2-kube-api-access-v2zbx\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:45:04.648960 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:04.648929    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722785-ln79q"
Jul 06 19:45:04.649128 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:04.648928    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722785-ln79q" event={"ID":"1957345a-0d0f-4461-b505-cf9fab8e40f2","Type":"ContainerDied","Data":"dd8d1a25d3357e61dff1967eb35e52db734b487264fd3f7cdd85bc1134acf356"}
Jul 06 19:45:04.649128 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:04.649052    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd8d1a25d3357e61dff1967eb35e52db734b487264fd3f7cdd85bc1134acf356"
Jul 06 19:45:30.862470 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:30.862372    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:45:39.636568 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:39.636528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:45:47.852638 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:47.852577    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:45:52.978593 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:52.978560    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:45:55.904966 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:55.904920    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:45:56.061348 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:56.061313    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:45:56.422914 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:45:56.422884    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:03.352871 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.352832    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:03.488956 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.488915    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:03.653465 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.653430    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"]
Jul 06 19:46:03.653818 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.653806    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1957345a-0d0f-4461-b505-cf9fab8e40f2" containerName="cleanup"
Jul 06 19:46:03.653865 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.653820    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1957345a-0d0f-4461-b505-cf9fab8e40f2" containerName="cleanup"
Jul 06 19:46:03.653899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.653876    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1957345a-0d0f-4461-b505-cf9fab8e40f2" containerName="cleanup"
Jul 06 19:46:03.657029 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.657013    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.682285 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.682258    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5ccdcc20-openshift-default-dockercfg-96b2w\""
Jul 06 19:46:03.705558 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.705529    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"]
Jul 06 19:46:03.725139 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.725100    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:03.755105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.755069    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2rj2\" (UniqueName: \"kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-kube-api-access-p2rj2\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.755260 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.755111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-credential-socket\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.755260 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.755184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-token\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.755260 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.755224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-data\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.755260 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.755250    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-socket\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.755445 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.755282    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-certs\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.755445 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.755299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-envoy\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.755445 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.755321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-podinfo\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.755445 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.755370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istiod-ca-cert\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.856409 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.856373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-token\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.856613 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.856423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-data\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.856613 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.856453    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-socket\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.856613 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.856494    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-certs\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.856613 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.856516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-envoy\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.856613 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.856544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-podinfo\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.856922 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.856644    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istiod-ca-cert\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.856922 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.856687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2rj2\" (UniqueName: \"kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-kube-api-access-p2rj2\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.856922 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.856744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-credential-socket\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.856922 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.856897    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-data\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.857133 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.857056    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-credential-socket\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.857133 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.857091    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-certs\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.857241 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.857174    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-socket\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.857495 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.857466    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istiod-ca-cert\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.858823 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.858801    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-envoy\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.859051 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.859033    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-podinfo\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.891784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.891719    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-token\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.893143 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.893121    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2rj2\" (UniqueName: \"kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-kube-api-access-p2rj2\") pod \"e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") " pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:03.954755 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.954722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:03.966497 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:03.966476    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:04.134999 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.134950    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"]
Jul 06 19:46:04.137734 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:46:04.137682    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803048bb_6c7d_4b1a_8686_6f8aaa5cc04f.slice/crio-64e94491adac4740eeaa47aba9c9a6e8be95e41c82d0d84509ca1c67108d24a7 WatchSource:0}: Error finding container 64e94491adac4740eeaa47aba9c9a6e8be95e41c82d0d84509ca1c67108d24a7: Status 404 returned error can't find the container with id 64e94491adac4740eeaa47aba9c9a6e8be95e41c82d0d84509ca1c67108d24a7
Jul 06 19:46:04.139682 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.139652    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:46:04.139767 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.139745    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:46:04.139801 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.139776    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:46:04.827106 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.827070    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:04.936120 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.936087    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth" event={"ID":"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f","Type":"ContainerStarted","Data":"cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac"}
Jul 06 19:46:04.936341 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.936138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth" event={"ID":"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f","Type":"ContainerStarted","Data":"64e94491adac4740eeaa47aba9c9a6e8be95e41c82d0d84509ca1c67108d24a7"}
Jul 06 19:46:04.955924 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.955889    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"]
Jul 06 19:46:04.959293 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.959276    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:04.963357 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.963334    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-5ccdcc20-serving-cert\""
Jul 06 19:46:04.966608 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:04.966587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:05.000630 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.000598    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"]
Jul 06 19:46:05.004204 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.004147    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth" podStartSLOduration=2.004124002 podStartE2EDuration="2.004124002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:46:05.002216337 +0000 UTC m=+1569.374698071" watchObservedRunningTime="2026-07-06 19:46:05.004124002 +0000 UTC m=+1569.376605734"
Jul 06 19:46:05.029422 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.029391    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:05.068534 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.068498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1519aa33-e4fc-409e-b136-3f521b201549-maas-api-tls\") pod \"maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") " pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.068773 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.068632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1519aa33-e4fc-409e-b136-3f521b201549-openshift-service-ca\") pod \"maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") " pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.068773 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.068741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz4vb\" (UniqueName: \"kubernetes.io/projected/1519aa33-e4fc-409e-b136-3f521b201549-kube-api-access-cz4vb\") pod \"maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") " pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.169951 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.169914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1519aa33-e4fc-409e-b136-3f521b201549-maas-api-tls\") pod \"maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") " pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.170160 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.169963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1519aa33-e4fc-409e-b136-3f521b201549-openshift-service-ca\") pod \"maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") " pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.170160 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.170008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz4vb\" (UniqueName: \"kubernetes.io/projected/1519aa33-e4fc-409e-b136-3f521b201549-kube-api-access-cz4vb\") pod \"maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") " pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.170160 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:46:05.170082    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-5ccdcc20-serving-cert: secret "maas-api-e2e-ait-5ccdcc20-serving-cert" not found
Jul 06 19:46:05.170331 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:46:05.170177    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1519aa33-e4fc-409e-b136-3f521b201549-maas-api-tls podName:1519aa33-e4fc-409e-b136-3f521b201549 nodeName:}" failed. No retries permitted until 2026-07-06 19:46:05.67015581 +0000 UTC m=+1570.042637529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1519aa33-e4fc-409e-b136-3f521b201549-maas-api-tls") pod "maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6" (UID: "1519aa33-e4fc-409e-b136-3f521b201549") : secret "maas-api-e2e-ait-5ccdcc20-serving-cert" not found
Jul 06 19:46:05.170694 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.170667    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1519aa33-e4fc-409e-b136-3f521b201549-openshift-service-ca\") pod \"maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") " pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.171867 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.171842    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:05.187460 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.187434    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz4vb\" (UniqueName: \"kubernetes.io/projected/1519aa33-e4fc-409e-b136-3f521b201549-kube-api-access-cz4vb\") pod \"maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") " pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.602426 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.602385    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:05.674938 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.674892    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1519aa33-e4fc-409e-b136-3f521b201549-maas-api-tls\") pod \"maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") " pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.677340 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.677316    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1519aa33-e4fc-409e-b136-3f521b201549-maas-api-tls\") pod \"maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") " pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.870020 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.869928    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:05.925333 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.925298    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:05.972267 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:05.972241    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:06.017360 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:06.017337    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"]
Jul 06 19:46:06.019013 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:46:06.018978    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1519aa33_e4fc_409e_b136_3f521b201549.slice/crio-ea7b1d49b23efd07172a1b8f5fb465ed1bbeaf58aed71c769260c0a3d81983a2 WatchSource:0}: Error finding container ea7b1d49b23efd07172a1b8f5fb465ed1bbeaf58aed71c769260c0a3d81983a2: Status 404 returned error can't find the container with id ea7b1d49b23efd07172a1b8f5fb465ed1bbeaf58aed71c769260c0a3d81983a2
Jul 06 19:46:06.020548 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:06.020533    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:46:06.043261 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:06.043227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:06.948536 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:06.948504    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6" event={"ID":"1519aa33-e4fc-409e-b136-3f521b201549","Type":"ContainerStarted","Data":"bd873608cba406bc969a609d64078edbcf34bb21818c6c395b23e45f997a6a5a"}
Jul 06 19:46:06.949107 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:06.948567    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6" event={"ID":"1519aa33-e4fc-409e-b136-3f521b201549","Type":"ContainerStarted","Data":"ea7b1d49b23efd07172a1b8f5fb465ed1bbeaf58aed71c769260c0a3d81983a2"}
Jul 06 19:46:06.949107 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:06.948595    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:06.949107 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:06.948953    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:06.949766 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:06.949747    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:06.980033 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:06.979984    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6" podStartSLOduration=2.519803892 podStartE2EDuration="2.979969315s" totalImagesPullingTime="460.165423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:46:06.979818467 +0000 UTC m=+1571.352300216" watchObservedRunningTime="2026-07-06 19:46:06.979969315 +0000 UTC m=+1571.352451047"
Jul 06 19:46:07.687042 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:07.687001    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:12.842319 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:12.842287    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"]
Jul 06 19:46:12.842872 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:12.842466    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6" podUID="1519aa33-e4fc-409e-b136-3f521b201549" containerName="maas-api" containerID="cri-o://bd873608cba406bc969a609d64078edbcf34bb21818c6c395b23e45f997a6a5a" gracePeriod=30
Jul 06 19:46:12.848278 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:12.848253    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:12.870575 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:12.870481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:12.960383 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:12.960308    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:12.982619 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:12.982587    2579 generic.go:356] "Generic (PLEG): container finished" podID="1519aa33-e4fc-409e-b136-3f521b201549" containerID="bd873608cba406bc969a609d64078edbcf34bb21818c6c395b23e45f997a6a5a" exitCode=0
Jul 06 19:46:12.982819 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:12.982675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6" event={"ID":"1519aa33-e4fc-409e-b136-3f521b201549","Type":"ContainerDied","Data":"bd873608cba406bc969a609d64078edbcf34bb21818c6c395b23e45f997a6a5a"}
Jul 06 19:46:13.027387 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.027350    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"]
Jul 06 19:46:13.027579 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.027555    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth" podUID="803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" containerName="istio-proxy" containerID="cri-o://cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac" gracePeriod=30
Jul 06 19:46:13.079817 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.079725    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:13.137306 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.137280    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:13.181537 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.181482    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:13.250824 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.250787    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz4vb\" (UniqueName: \"kubernetes.io/projected/1519aa33-e4fc-409e-b136-3f521b201549-kube-api-access-cz4vb\") pod \"1519aa33-e4fc-409e-b136-3f521b201549\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") "
Jul 06 19:46:13.251012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.250852    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1519aa33-e4fc-409e-b136-3f521b201549-maas-api-tls\") pod \"1519aa33-e4fc-409e-b136-3f521b201549\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") "
Jul 06 19:46:13.251012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.250887    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1519aa33-e4fc-409e-b136-3f521b201549-openshift-service-ca\") pod \"1519aa33-e4fc-409e-b136-3f521b201549\" (UID: \"1519aa33-e4fc-409e-b136-3f521b201549\") "
Jul 06 19:46:13.251262 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.251238    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1519aa33-e4fc-409e-b136-3f521b201549-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1519aa33-e4fc-409e-b136-3f521b201549" (UID: "1519aa33-e4fc-409e-b136-3f521b201549"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:46:13.252876 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.252855    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1519aa33-e4fc-409e-b136-3f521b201549-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1519aa33-e4fc-409e-b136-3f521b201549" (UID: "1519aa33-e4fc-409e-b136-3f521b201549"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:46:13.252969 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.252952    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1519aa33-e4fc-409e-b136-3f521b201549-kube-api-access-cz4vb" (OuterVolumeSpecName: "kube-api-access-cz4vb") pod "1519aa33-e4fc-409e-b136-3f521b201549" (UID: "1519aa33-e4fc-409e-b136-3f521b201549"). InnerVolumeSpecName "kube-api-access-cz4vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:13.352631 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.352592    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1519aa33-e4fc-409e-b136-3f521b201549-maas-api-tls\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.352631 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.352622    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1519aa33-e4fc-409e-b136-3f521b201549-openshift-service-ca\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.352631 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.352633    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz4vb\" (UniqueName: \"kubernetes.io/projected/1519aa33-e4fc-409e-b136-3f521b201549-kube-api-access-cz4vb\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:13.990021 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.989934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6" event={"ID":"1519aa33-e4fc-409e-b136-3f521b201549","Type":"ContainerDied","Data":"ea7b1d49b23efd07172a1b8f5fb465ed1bbeaf58aed71c769260c0a3d81983a2"}
Jul 06 19:46:13.990021 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.989961    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"
Jul 06 19:46:13.990021 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:13.990010    2579 scope.go:117] "RemoveContainer" containerID="bd873608cba406bc969a609d64078edbcf34bb21818c6c395b23e45f997a6a5a"
Jul 06 19:46:14.030153 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:14.030126    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"]
Jul 06 19:46:14.035094 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:14.035071    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-5ccdcc20-74d468fbf7-4hzk6"]
Jul 06 19:46:14.105508 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:14.105473    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1519aa33-e4fc-409e-b136-3f521b201549" path="/var/lib/kubelet/pods/1519aa33-e4fc-409e-b136-3f521b201549/volumes"
Jul 06 19:46:14.617717 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:14.617664    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:19.487332 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.487298    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:19.628439 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628407    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-socket\") pod \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") "
Jul 06 19:46:19.628626 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628449    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-credential-socket\") pod \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") "
Jul 06 19:46:19.628626 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628472    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-envoy\") pod \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") "
Jul 06 19:46:19.628626 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628500    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-podinfo\") pod \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") "
Jul 06 19:46:19.628626 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628548    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-data\") pod \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") "
Jul 06 19:46:19.628626 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628573    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istiod-ca-cert\") pod \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") "
Jul 06 19:46:19.628626 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628598    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-certs\") pod \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") "
Jul 06 19:46:19.629044 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628771    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" (UID: "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:19.629044 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628771    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2rj2\" (UniqueName: \"kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-kube-api-access-p2rj2\") pod \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") "
Jul 06 19:46:19.629044 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628863    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" (UID: "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:19.629044 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.628919    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-token\") pod \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\" (UID: \"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f\") "
Jul 06 19:46:19.629368 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.629301    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:19.629368 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.629328    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-credential-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:19.629556 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.629424    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" (UID: "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:19.629625 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.629566    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" (UID: "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:46:19.629918 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.629857    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-data" (OuterVolumeSpecName: "istio-data") pod "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" (UID: "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:19.631387 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.631290    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" (UID: "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:46:19.631387 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.631371    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" (UID: "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:19.631925 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.631899    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-kube-api-access-p2rj2" (OuterVolumeSpecName: "kube-api-access-p2rj2") pod "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" (UID: "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f"). InnerVolumeSpecName "kube-api-access-p2rj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:19.631925 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.631912    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-token" (OuterVolumeSpecName: "istio-token") pod "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" (UID: "803048bb-6c7d-4b1a-8686-6f8aaa5cc04f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:19.730681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.730647    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-token\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:19.730681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.730677    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-envoy\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:19.730681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.730686    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-podinfo\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:19.730931 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.730695    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istio-data\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:19.730931 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.730731    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-istiod-ca-cert\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:19.730931 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.730742    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-workload-certs\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:19.730931 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:19.730749    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2rj2\" (UniqueName: \"kubernetes.io/projected/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f-kube-api-access-p2rj2\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:20.021861 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.021777    2579 generic.go:356] "Generic (PLEG): container finished" podID="803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" containerID="cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac" exitCode=0
Jul 06 19:46:20.021861 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.021839    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"
Jul 06 19:46:20.022046 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.021843    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth" event={"ID":"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f","Type":"ContainerDied","Data":"cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac"}
Jul 06 19:46:20.022046 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.021981    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth" event={"ID":"803048bb-6c7d-4b1a-8686-6f8aaa5cc04f","Type":"ContainerDied","Data":"64e94491adac4740eeaa47aba9c9a6e8be95e41c82d0d84509ca1c67108d24a7"}
Jul 06 19:46:20.022046 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.022006    2579 scope.go:117] "RemoveContainer" containerID="cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac"
Jul 06 19:46:20.030886 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.030864    2579 scope.go:117] "RemoveContainer" containerID="cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac"
Jul 06 19:46:20.031177 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:46:20.031158    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac\": container with ID starting with cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac not found: ID does not exist" containerID="cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac"
Jul 06 19:46:20.031226 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.031186    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac"} err="failed to get container status \"cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac\": rpc error: code = NotFound desc = could not find container \"cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac\": container with ID starting with cd209545cf0b51a4679ba63d4ffacece836a3a8b514a723f9ce6c948d580faac not found: ID does not exist"
Jul 06 19:46:20.050430 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.050402    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"]
Jul 06 19:46:20.059192 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.059168    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5ccdcc20-openshift-default-7cc4845b85-6pxth"]
Jul 06 19:46:20.099964 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.099927    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" path="/var/lib/kubelet/pods/803048bb-6c7d-4b1a-8686-6f8aaa5cc04f/volumes"
Jul 06 19:46:20.374308 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.374275    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:20.490431 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.490378    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:20.561989 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.561954    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"]
Jul 06 19:46:20.562306 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.562294    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" containerName="istio-proxy"
Jul 06 19:46:20.562352 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.562308    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" containerName="istio-proxy"
Jul 06 19:46:20.562352 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.562328    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1519aa33-e4fc-409e-b136-3f521b201549" containerName="maas-api"
Jul 06 19:46:20.562352 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.562334    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1519aa33-e4fc-409e-b136-3f521b201549" containerName="maas-api"
Jul 06 19:46:20.562444 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.562393    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="803048bb-6c7d-4b1a-8686-6f8aaa5cc04f" containerName="istio-proxy"
Jul 06 19:46:20.562444 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.562405    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1519aa33-e4fc-409e-b136-3f521b201549" containerName="maas-api"
Jul 06 19:46:20.566791 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.566775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.570979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.570959    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-eb096e47-openshift-default-dockercfg-9m9p9\""
Jul 06 19:46:20.611333 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.611300    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"]
Jul 06 19:46:20.681026 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.680943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:20.740533 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.740501    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-token\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.740751 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.740536    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-credential-socket\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.740751 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.740557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-data\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.740751 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.740607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-podinfo\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.740751 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.740653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwzp2\" (UniqueName: \"kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-kube-api-access-bwzp2\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.740981 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.740764    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-envoy\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.740981 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.740847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-certs\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.740981 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.740880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a982e98-c19b-46af-8004-5ef306aa1b8f-istiod-ca-cert\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.740981 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.740960    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-socket\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.808902 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.808863    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:20.841532 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.841501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-token\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.841532 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.841535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-credential-socket\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.841777 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.841552    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-data\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.841777 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.841571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-podinfo\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.841777 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.841598    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwzp2\" (UniqueName: \"kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-kube-api-access-bwzp2\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.841777 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.841666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-envoy\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.841777 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.841744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-certs\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.841777 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.841768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a982e98-c19b-46af-8004-5ef306aa1b8f-istiod-ca-cert\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.842095 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.841966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-socket\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.842095 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.841977    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-data\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.842095 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.842079    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-credential-socket\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.842220 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.842104    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-certs\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.842356 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.842330    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-socket\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.842545 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.842528    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a982e98-c19b-46af-8004-5ef306aa1b8f-istiod-ca-cert\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.843931 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.843912    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-envoy\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.844178 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.844160    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-podinfo\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.853218 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.853187    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-token\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.853336 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.853320    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwzp2\" (UniqueName: \"kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-kube-api-access-bwzp2\") pod \"e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") " pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:20.876832 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:20.876810    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:21.022332 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.022306    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"]
Jul 06 19:46:21.024791 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:46:21.024765    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a982e98_c19b_46af_8004_5ef306aa1b8f.slice/crio-7218ade9050a1a9db125e5ed6794326eedd2f895414ed688d6da96969bdf9597 WatchSource:0}: Error finding container 7218ade9050a1a9db125e5ed6794326eedd2f895414ed688d6da96969bdf9597: Status 404 returned error can't find the container with id 7218ade9050a1a9db125e5ed6794326eedd2f895414ed688d6da96969bdf9597
Jul 06 19:46:21.027003 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.026972    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:46:21.027076 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.027038    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:46:21.027076 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.027064    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:46:21.758531 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.758490    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:21.895203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.895167    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"]
Jul 06 19:46:21.899156 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.899136    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:21.902783 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.902764    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-eb096e47-serving-cert\""
Jul 06 19:46:21.924153 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.924123    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"]
Jul 06 19:46:21.927437 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.927401    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:21.952141 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.952110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-maas-api-tls\") pod \"maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") " pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:21.952312 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.952171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv5z5\" (UniqueName: \"kubernetes.io/projected/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-kube-api-access-mv5z5\") pod \"maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") " pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:21.952312 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:21.952207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-openshift-service-ca\") pod \"maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") " pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:22.033830 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.033743    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm" event={"ID":"7a982e98-c19b-46af-8004-5ef306aa1b8f","Type":"ContainerStarted","Data":"2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0"}
Jul 06 19:46:22.033830 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.033801    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm" event={"ID":"7a982e98-c19b-46af-8004-5ef306aa1b8f","Type":"ContainerStarted","Data":"7218ade9050a1a9db125e5ed6794326eedd2f895414ed688d6da96969bdf9597"}
Jul 06 19:46:22.052772 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.052743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv5z5\" (UniqueName: \"kubernetes.io/projected/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-kube-api-access-mv5z5\") pod \"maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") " pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:22.052929 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.052806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-openshift-service-ca\") pod \"maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") " pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:22.052929 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.052885    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-maas-api-tls\") pod \"maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") " pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:22.053077 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:46:22.052975    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-eb096e47-serving-cert: secret "maas-api-e2e-ait-eb096e47-serving-cert" not found
Jul 06 19:46:22.053077 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:46:22.053033    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-maas-api-tls podName:02e8f9ad-f38a-4f96-a490-3ab33749a7cf nodeName:}" failed. No retries permitted until 2026-07-06 19:46:22.553013158 +0000 UTC m=+1586.925494868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-maas-api-tls") pod "maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd" (UID: "02e8f9ad-f38a-4f96-a490-3ab33749a7cf") : secret "maas-api-e2e-ait-eb096e47-serving-cert" not found
Jul 06 19:46:22.053618 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.053597    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-openshift-service-ca\") pod \"maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") " pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:22.073184 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.073162    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv5z5\" (UniqueName: \"kubernetes.io/projected/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-kube-api-access-mv5z5\") pod \"maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") " pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:22.075733 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.075659    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm" podStartSLOduration=2.075646304 podStartE2EDuration="2.075646304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:46:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:46:22.073340549 +0000 UTC m=+1586.445822296" watchObservedRunningTime="2026-07-06 19:46:22.075646304 +0000 UTC m=+1586.448128036"
Jul 06 19:46:22.083867 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.083838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:22.503386 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.503343    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:22.555847 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.555811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-maas-api-tls\") pod \"maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") " pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:22.558305 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.558284    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-maas-api-tls\") pod \"maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") " pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:22.651880 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.651838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:22.804652 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.804558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:22.810363 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.810330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:22.877580 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.877545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:22.882641 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.882613    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:22.984688 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:22.984654    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"]
Jul 06 19:46:22.985590 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:46:22.985562    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e8f9ad_f38a_4f96_a490_3ab33749a7cf.slice/crio-8264b0316189641618dc9ae69b9b21b25e37ac6423d34864eac716b0dcd4bcac WatchSource:0}: Error finding container 8264b0316189641618dc9ae69b9b21b25e37ac6423d34864eac716b0dcd4bcac: Status 404 returned error can't find the container with id 8264b0316189641618dc9ae69b9b21b25e37ac6423d34864eac716b0dcd4bcac
Jul 06 19:46:23.040757 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:23.040726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd" event={"ID":"02e8f9ad-f38a-4f96-a490-3ab33749a7cf","Type":"ContainerStarted","Data":"8264b0316189641618dc9ae69b9b21b25e37ac6423d34864eac716b0dcd4bcac"}
Jul 06 19:46:23.041034 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:23.041017    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:23.042112 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:23.042094    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:23.830149 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:23.830119    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:24.046870 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:24.046765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd" event={"ID":"02e8f9ad-f38a-4f96-a490-3ab33749a7cf","Type":"ContainerStarted","Data":"2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e"}
Jul 06 19:46:24.047098 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:24.046881    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:24.071361 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:24.071315    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd" podStartSLOduration=2.619158734 podStartE2EDuration="3.071298925s" totalImagesPullingTime="452.140191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:46:24.069352566 +0000 UTC m=+1588.441834301" watchObservedRunningTime="2026-07-06 19:46:24.071298925 +0000 UTC m=+1588.443780660"
Jul 06 19:46:29.753323 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:29.753289    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"]
Jul 06 19:46:29.753737 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:29.753480    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd" podUID="02e8f9ad-f38a-4f96-a490-3ab33749a7cf" containerName="maas-api" containerID="cri-o://2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e" gracePeriod=30
Jul 06 19:46:29.763742 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:29.762932    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd" podUID="02e8f9ad-f38a-4f96-a490-3ab33749a7cf" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.44:8443/health\": read tcp 10.133.0.2:42202->10.133.0.44:8443: read: connection reset by peer"
Jul 06 19:46:29.797817 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:29.797773    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:29.895946 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:29.895906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:30.039363 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.039340    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:30.087967 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.087929    2579 generic.go:356] "Generic (PLEG): container finished" podID="02e8f9ad-f38a-4f96-a490-3ab33749a7cf" containerID="2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e" exitCode=0
Jul 06 19:46:30.088165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.087984    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"
Jul 06 19:46:30.088165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.088012    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd" event={"ID":"02e8f9ad-f38a-4f96-a490-3ab33749a7cf","Type":"ContainerDied","Data":"2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e"}
Jul 06 19:46:30.088165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.088072    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd" event={"ID":"02e8f9ad-f38a-4f96-a490-3ab33749a7cf","Type":"ContainerDied","Data":"8264b0316189641618dc9ae69b9b21b25e37ac6423d34864eac716b0dcd4bcac"}
Jul 06 19:46:30.088165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.088097    2579 scope.go:117] "RemoveContainer" containerID="2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e"
Jul 06 19:46:30.097122 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.097102    2579 scope.go:117] "RemoveContainer" containerID="2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e"
Jul 06 19:46:30.097343 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:46:30.097323    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e\": container with ID starting with 2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e not found: ID does not exist" containerID="2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e"
Jul 06 19:46:30.097387 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.097354    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e"} err="failed to get container status \"2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e\": rpc error: code = NotFound desc = could not find container \"2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e\": container with ID starting with 2e05c9f8de5a01d4bfd3e136d6d028830c51f03c46c3c2131c97afe353a27a2e not found: ID does not exist"
Jul 06 19:46:30.116688 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.116661    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-openshift-service-ca\") pod \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") "
Jul 06 19:46:30.116865 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.116737    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-maas-api-tls\") pod \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") "
Jul 06 19:46:30.116865 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.116761    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv5z5\" (UniqueName: \"kubernetes.io/projected/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-kube-api-access-mv5z5\") pod \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\" (UID: \"02e8f9ad-f38a-4f96-a490-3ab33749a7cf\") "
Jul 06 19:46:30.117033 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.117005    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02e8f9ad-f38a-4f96-a490-3ab33749a7cf" (UID: "02e8f9ad-f38a-4f96-a490-3ab33749a7cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:46:30.118802 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.118769    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02e8f9ad-f38a-4f96-a490-3ab33749a7cf" (UID: "02e8f9ad-f38a-4f96-a490-3ab33749a7cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:46:30.118904 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.118884    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-kube-api-access-mv5z5" (OuterVolumeSpecName: "kube-api-access-mv5z5") pod "02e8f9ad-f38a-4f96-a490-3ab33749a7cf" (UID: "02e8f9ad-f38a-4f96-a490-3ab33749a7cf"). InnerVolumeSpecName "kube-api-access-mv5z5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:30.217938 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.217899    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-maas-api-tls\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:30.217938 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.217930    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv5z5\" (UniqueName: \"kubernetes.io/projected/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-kube-api-access-mv5z5\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:30.217938 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.217940    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e8f9ad-f38a-4f96-a490-3ab33749a7cf-openshift-service-ca\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:30.412722 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.412674    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"]
Jul 06 19:46:30.419947 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.419910    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-eb096e47-9f85c76c6-8s2fd"]
Jul 06 19:46:30.761538 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.761448    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"]
Jul 06 19:46:30.761948 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.761651    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm" podUID="7a982e98-c19b-46af-8004-5ef306aa1b8f" containerName="istio-proxy" containerID="cri-o://2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0" gracePeriod=30
Jul 06 19:46:30.795953 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.795913    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:30.888253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:30.888217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:32.100382 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:32.100341    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e8f9ad-f38a-4f96-a490-3ab33749a7cf" path="/var/lib/kubelet/pods/02e8f9ad-f38a-4f96-a490-3ab33749a7cf/volumes"
Jul 06 19:46:33.819289 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.819266    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:33.854751 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.854721    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-credential-socket\") pod \"7a982e98-c19b-46af-8004-5ef306aa1b8f\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") "
Jul 06 19:46:33.854967 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.854818    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-token\") pod \"7a982e98-c19b-46af-8004-5ef306aa1b8f\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") "
Jul 06 19:46:33.854967 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.854845    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-envoy\") pod \"7a982e98-c19b-46af-8004-5ef306aa1b8f\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") "
Jul 06 19:46:33.854967 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.854875    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a982e98-c19b-46af-8004-5ef306aa1b8f-istiod-ca-cert\") pod \"7a982e98-c19b-46af-8004-5ef306aa1b8f\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") "
Jul 06 19:46:33.854967 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.854914    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-podinfo\") pod \"7a982e98-c19b-46af-8004-5ef306aa1b8f\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") "
Jul 06 19:46:33.854967 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.854940    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-socket\") pod \"7a982e98-c19b-46af-8004-5ef306aa1b8f\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") "
Jul 06 19:46:33.854967 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.854949    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a982e98-c19b-46af-8004-5ef306aa1b8f" (UID: "7a982e98-c19b-46af-8004-5ef306aa1b8f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:33.855355 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.854977    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-certs\") pod \"7a982e98-c19b-46af-8004-5ef306aa1b8f\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") "
Jul 06 19:46:33.855355 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.855032    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-data\") pod \"7a982e98-c19b-46af-8004-5ef306aa1b8f\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") "
Jul 06 19:46:33.855355 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.855070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwzp2\" (UniqueName: \"kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-kube-api-access-bwzp2\") pod \"7a982e98-c19b-46af-8004-5ef306aa1b8f\" (UID: \"7a982e98-c19b-46af-8004-5ef306aa1b8f\") "
Jul 06 19:46:33.855511 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.855374    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-credential-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:33.855576 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.855512    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a982e98-c19b-46af-8004-5ef306aa1b8f" (UID: "7a982e98-c19b-46af-8004-5ef306aa1b8f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:33.855618 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.855569    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a982e98-c19b-46af-8004-5ef306aa1b8f" (UID: "7a982e98-c19b-46af-8004-5ef306aa1b8f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:33.855752 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.855698    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a982e98-c19b-46af-8004-5ef306aa1b8f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a982e98-c19b-46af-8004-5ef306aa1b8f" (UID: "7a982e98-c19b-46af-8004-5ef306aa1b8f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:46:33.856146 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.856113    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a982e98-c19b-46af-8004-5ef306aa1b8f" (UID: "7a982e98-c19b-46af-8004-5ef306aa1b8f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:33.857061 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.857027    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a982e98-c19b-46af-8004-5ef306aa1b8f" (UID: "7a982e98-c19b-46af-8004-5ef306aa1b8f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:33.857507 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.857489    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a982e98-c19b-46af-8004-5ef306aa1b8f" (UID: "7a982e98-c19b-46af-8004-5ef306aa1b8f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:33.857589 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.857565    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-kube-api-access-bwzp2" (OuterVolumeSpecName: "kube-api-access-bwzp2") pod "7a982e98-c19b-46af-8004-5ef306aa1b8f" (UID: "7a982e98-c19b-46af-8004-5ef306aa1b8f"). InnerVolumeSpecName "kube-api-access-bwzp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:33.857914 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.857892    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a982e98-c19b-46af-8004-5ef306aa1b8f" (UID: "7a982e98-c19b-46af-8004-5ef306aa1b8f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:46:33.876437 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.876407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:33.956322 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.956290    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-data\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:33.956322 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.956318    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwzp2\" (UniqueName: \"kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-kube-api-access-bwzp2\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:33.956322 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.956328    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-token\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:33.956564 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.956336    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-envoy\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:33.956564 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.956344    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a982e98-c19b-46af-8004-5ef306aa1b8f-istiod-ca-cert\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:33.956564 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.956352    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a982e98-c19b-46af-8004-5ef306aa1b8f-istio-podinfo\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:33.956564 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.956359    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:33.956564 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:33.956368    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a982e98-c19b-46af-8004-5ef306aa1b8f-workload-certs\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:34.109985 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:34.109958    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a982e98-c19b-46af-8004-5ef306aa1b8f" containerID="2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0" exitCode=0
Jul 06 19:46:34.110115 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:34.109999    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm" event={"ID":"7a982e98-c19b-46af-8004-5ef306aa1b8f","Type":"ContainerDied","Data":"2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0"}
Jul 06 19:46:34.110115 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:34.110008    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"
Jul 06 19:46:34.110115 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:34.110038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm" event={"ID":"7a982e98-c19b-46af-8004-5ef306aa1b8f","Type":"ContainerDied","Data":"7218ade9050a1a9db125e5ed6794326eedd2f895414ed688d6da96969bdf9597"}
Jul 06 19:46:34.110115 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:34.110057    2579 scope.go:117] "RemoveContainer" containerID="2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0"
Jul 06 19:46:34.118352 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:34.118332    2579 scope.go:117] "RemoveContainer" containerID="2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0"
Jul 06 19:46:34.118604 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:46:34.118587    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0\": container with ID starting with 2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0 not found: ID does not exist" containerID="2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0"
Jul 06 19:46:34.118653 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:34.118613    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0"} err="failed to get container status \"2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0\": rpc error: code = NotFound desc = could not find container \"2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0\": container with ID starting with 2ce2a22ec4c436fa7dc438ad5d6e4fc331446ed958cf057e06da02d3e41abed0 not found: ID does not exist"
Jul 06 19:46:34.130988 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:34.130965    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"]
Jul 06 19:46:34.134825 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:34.134803    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-eb096e47-openshift-default-7b767644cf-br5wm"]
Jul 06 19:46:36.100746 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:36.100715    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a982e98-c19b-46af-8004-5ef306aa1b8f" path="/var/lib/kubelet/pods/7a982e98-c19b-46af-8004-5ef306aa1b8f/volumes"
Jul 06 19:46:37.069261 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.069227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:37.171828 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.171777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:37.276468 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.276434    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"]
Jul 06 19:46:37.276832 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.276817    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e8f9ad-f38a-4f96-a490-3ab33749a7cf" containerName="maas-api"
Jul 06 19:46:37.276832 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.276833    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e8f9ad-f38a-4f96-a490-3ab33749a7cf" containerName="maas-api"
Jul 06 19:46:37.276924 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.276850    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a982e98-c19b-46af-8004-5ef306aa1b8f" containerName="istio-proxy"
Jul 06 19:46:37.276924 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.276856    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a982e98-c19b-46af-8004-5ef306aa1b8f" containerName="istio-proxy"
Jul 06 19:46:37.276924 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.276923    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a982e98-c19b-46af-8004-5ef306aa1b8f" containerName="istio-proxy"
Jul 06 19:46:37.277056 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.276931    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e8f9ad-f38a-4f96-a490-3ab33749a7cf" containerName="maas-api"
Jul 06 19:46:37.281535 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.281511    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.287146 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.287120    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-fb8958b1-openshift-default-dockercfg-zgk2w\""
Jul 06 19:46:37.308592 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.308562    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"]
Jul 06 19:46:37.355339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.355297    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:37.387588 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.387551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvdxl\" (UniqueName: \"kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-kube-api-access-fvdxl\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.387878 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.387752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-credential-socket\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.387878 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.387844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-data\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.388265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.387938    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-podinfo\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.388265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.387991    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istiod-ca-cert\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.388265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.388036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-certs\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.388265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.388067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-socket\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.388265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.388096    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-token\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.388265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.388149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-envoy\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.458154 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.458121    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:37.489333 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istiod-ca-cert\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.489499 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-certs\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.489499 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489362    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-socket\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.489499 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489384    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-token\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.489499 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-envoy\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.489499 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvdxl\" (UniqueName: \"kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-kube-api-access-fvdxl\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.489499 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-credential-socket\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.489850 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-data\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.489850 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-podinfo\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.489850 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489836    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-certs\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.490033 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.489993    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-credential-socket\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.490171 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.490146    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-data\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.490283 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.490155    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istiod-ca-cert\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.490283 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.490198    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-socket\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.491762 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.491741    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-envoy\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.492121 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.492101    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-podinfo\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.503925 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.503899    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-token\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.506401 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.506376    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvdxl\" (UniqueName: \"kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-kube-api-access-fvdxl\") pod \"e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") " pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.591801 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.591768    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:37.738829 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.738800    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"]
Jul 06 19:46:37.740642 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:46:37.740617    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e53fb8_d2a5_437e_9cb9_2ae88be57ede.slice/crio-eed595d150900b2d65c30b4edcaf20882adb5e18f96ab8bbaa53ef4be72c2d23 WatchSource:0}: Error finding container eed595d150900b2d65c30b4edcaf20882adb5e18f96ab8bbaa53ef4be72c2d23: Status 404 returned error can't find the container with id eed595d150900b2d65c30b4edcaf20882adb5e18f96ab8bbaa53ef4be72c2d23
Jul 06 19:46:37.742765 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.742732    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:46:37.742852 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.742804    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:46:37.742852 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:37.742831    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:46:38.132715 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.132677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l" event={"ID":"18e53fb8-d2a5-437e-9cb9-2ae88be57ede","Type":"ContainerStarted","Data":"1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15"}
Jul 06 19:46:38.132926 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.132746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l" event={"ID":"18e53fb8-d2a5-437e-9cb9-2ae88be57ede","Type":"ContainerStarted","Data":"eed595d150900b2d65c30b4edcaf20882adb5e18f96ab8bbaa53ef4be72c2d23"}
Jul 06 19:46:38.160123 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.160079    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l" podStartSLOduration=1.160063791 podStartE2EDuration="1.160063791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:46:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:46:38.15754797 +0000 UTC m=+1602.530029724" watchObservedRunningTime="2026-07-06 19:46:38.160063791 +0000 UTC m=+1602.532545580"
Jul 06 19:46:38.474247 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.474159    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:38.592366 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.592331    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:38.597747 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.597719    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:38.629328 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.629297    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"]
Jul 06 19:46:38.632774 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.632755    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:38.635304 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.635279    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-fb8958b1-serving-cert\""
Jul 06 19:46:38.650938 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.650913    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"]
Jul 06 19:46:38.652975 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.652947    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:38.700122 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.700087    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxlvz\" (UniqueName: \"kubernetes.io/projected/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-kube-api-access-sxlvz\") pod \"maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") " pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:38.700317 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.700126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-openshift-service-ca\") pod \"maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") " pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:38.700317 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.700166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-maas-api-tls\") pod \"maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") " pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:38.801036 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.800930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxlvz\" (UniqueName: \"kubernetes.io/projected/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-kube-api-access-sxlvz\") pod \"maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") " pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:38.801036 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.800973    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-openshift-service-ca\") pod \"maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") " pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:38.801036 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.801030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-maas-api-tls\") pod \"maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") " pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:38.801618 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.801580    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-openshift-service-ca\") pod \"maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") " pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:38.803518 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.803496    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-maas-api-tls\") pod \"maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") " pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:38.818917 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.818884    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxlvz\" (UniqueName: \"kubernetes.io/projected/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-kube-api-access-sxlvz\") pod \"maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") " pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:38.841435 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.841390    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:38.944031 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:38.943996    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:39.027490 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:39.027463    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:39.129800 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:39.129778    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"]
Jul 06 19:46:39.131550 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:46:39.131515    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00bbe430_8a12_4bba_bf07_9a5dbb460a3d.slice/crio-28cb212ec80f8119034642346ed4ee1329318f843576dbe9305573769fa5ff01 WatchSource:0}: Error finding container 28cb212ec80f8119034642346ed4ee1329318f843576dbe9305573769fa5ff01: Status 404 returned error can't find the container with id 28cb212ec80f8119034642346ed4ee1329318f843576dbe9305573769fa5ff01
Jul 06 19:46:39.138481 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:39.138452    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp" event={"ID":"00bbe430-8a12-4bba-bf07-9a5dbb460a3d","Type":"ContainerStarted","Data":"28cb212ec80f8119034642346ed4ee1329318f843576dbe9305573769fa5ff01"}
Jul 06 19:46:39.138750 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:39.138731    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:39.139913 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:39.139894    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:39.595610 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:39.595582    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:39.731139 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:39.731107    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:40.144437 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:40.144397    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp" event={"ID":"00bbe430-8a12-4bba-bf07-9a5dbb460a3d","Type":"ContainerStarted","Data":"8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff"}
Jul 06 19:46:40.144612 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:40.144464    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:40.176007 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:40.175958    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp" podStartSLOduration=1.6340078199999999 podStartE2EDuration="2.175943014s" totalImagesPullingTime="541.935194ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:46:40.17239607 +0000 UTC m=+1604.544877802" watchObservedRunningTime="2026-07-06 19:46:40.175943014 +0000 UTC m=+1604.548424745"
Jul 06 19:46:40.309221 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:40.309195    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:45.842031 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:45.841992    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"]
Jul 06 19:46:45.842536 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:45.842182    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp" podUID="00bbe430-8a12-4bba-bf07-9a5dbb460a3d" containerName="maas-api" containerID="cri-o://8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff" gracePeriod=30
Jul 06 19:46:45.847218 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:45.847193    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:45.895962 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:45.895929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:46.002076 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.002043    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:46.084731 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.075495    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"]
Jul 06 19:46:46.084731 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.080644    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l" podUID="18e53fb8-d2a5-437e-9cb9-2ae88be57ede" containerName="istio-proxy" containerID="cri-o://1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15" gracePeriod=30
Jul 06 19:46:46.135020 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.134997    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:46.184094 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.184058    2579 generic.go:356] "Generic (PLEG): container finished" podID="00bbe430-8a12-4bba-bf07-9a5dbb460a3d" containerID="8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff" exitCode=0
Jul 06 19:46:46.184274 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.184102    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"
Jul 06 19:46:46.184274 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.184149    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp" event={"ID":"00bbe430-8a12-4bba-bf07-9a5dbb460a3d","Type":"ContainerDied","Data":"8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff"}
Jul 06 19:46:46.184274 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.184207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp" event={"ID":"00bbe430-8a12-4bba-bf07-9a5dbb460a3d","Type":"ContainerDied","Data":"28cb212ec80f8119034642346ed4ee1329318f843576dbe9305573769fa5ff01"}
Jul 06 19:46:46.184274 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.184236    2579 scope.go:117] "RemoveContainer" containerID="8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff"
Jul 06 19:46:46.194396 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.194374    2579 scope.go:117] "RemoveContainer" containerID="8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff"
Jul 06 19:46:46.194713 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:46:46.194675    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff\": container with ID starting with 8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff not found: ID does not exist" containerID="8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff"
Jul 06 19:46:46.194797 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.194724    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff"} err="failed to get container status \"8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff\": rpc error: code = NotFound desc = could not find container \"8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff\": container with ID starting with 8d509ddaa86754f414355193fe349113f0473868326bd78703a17178e203a3ff not found: ID does not exist"
Jul 06 19:46:46.199099 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.199056    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:46.282523 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.282320    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxlvz\" (UniqueName: \"kubernetes.io/projected/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-kube-api-access-sxlvz\") pod \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") "
Jul 06 19:46:46.282523 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.282435    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-openshift-service-ca\") pod \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") "
Jul 06 19:46:46.282805 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.282582    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-maas-api-tls\") pod \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\" (UID: \"00bbe430-8a12-4bba-bf07-9a5dbb460a3d\") "
Jul 06 19:46:46.282805 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.282729    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00bbe430-8a12-4bba-bf07-9a5dbb460a3d" (UID: "00bbe430-8a12-4bba-bf07-9a5dbb460a3d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:46:46.282919 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.282905    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-openshift-service-ca\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:46.284657 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.284634    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-kube-api-access-sxlvz" (OuterVolumeSpecName: "kube-api-access-sxlvz") pod "00bbe430-8a12-4bba-bf07-9a5dbb460a3d" (UID: "00bbe430-8a12-4bba-bf07-9a5dbb460a3d"). InnerVolumeSpecName "kube-api-access-sxlvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:46.284907 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.284891    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00bbe430-8a12-4bba-bf07-9a5dbb460a3d" (UID: "00bbe430-8a12-4bba-bf07-9a5dbb460a3d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:46:46.362824 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.362788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:46.383833 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.383747    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-maas-api-tls\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:46.383833 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.383775    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxlvz\" (UniqueName: \"kubernetes.io/projected/00bbe430-8a12-4bba-bf07-9a5dbb460a3d-kube-api-access-sxlvz\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:46.515549 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.515504    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"]
Jul 06 19:46:46.519151 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:46.519126    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-fb8958b1-5fcb5c6ff4-dmxpp"]
Jul 06 19:46:47.727289 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:47.727254    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:48.101066 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:48.101032    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00bbe430-8a12-4bba-bf07-9a5dbb460a3d" path="/var/lib/kubelet/pods/00bbe430-8a12-4bba-bf07-9a5dbb460a3d/volumes"
Jul 06 19:46:49.988566 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:46:49.987944    2579 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e53fb8_d2a5_437e_9cb9_2ae88be57ede.slice/crio-1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15.scope\": RecentStats: unable to find data in memory cache]"
Jul 06 19:46:50.146066 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.146039    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:50.206485 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.206389    2579 generic.go:356] "Generic (PLEG): container finished" podID="18e53fb8-d2a5-437e-9cb9-2ae88be57ede" containerID="1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15" exitCode=0
Jul 06 19:46:50.206485 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.206435    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"
Jul 06 19:46:50.206681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.206486    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l" event={"ID":"18e53fb8-d2a5-437e-9cb9-2ae88be57ede","Type":"ContainerDied","Data":"1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15"}
Jul 06 19:46:50.206681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.206539    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l" event={"ID":"18e53fb8-d2a5-437e-9cb9-2ae88be57ede","Type":"ContainerDied","Data":"eed595d150900b2d65c30b4edcaf20882adb5e18f96ab8bbaa53ef4be72c2d23"}
Jul 06 19:46:50.206681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.206562    2579 scope.go:117] "RemoveContainer" containerID="1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15"
Jul 06 19:46:50.214860 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.214844    2579 scope.go:117] "RemoveContainer" containerID="1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15"
Jul 06 19:46:50.215116 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:46:50.215094    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15\": container with ID starting with 1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15 not found: ID does not exist" containerID="1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15"
Jul 06 19:46:50.215171 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.215123    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15"} err="failed to get container status \"1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15\": rpc error: code = NotFound desc = could not find container \"1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15\": container with ID starting with 1baa0836cb222921197b968f941f97d2d7b5f2d0a9f89220cdfcca6112223a15 not found: ID does not exist"
Jul 06 19:46:50.221451 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221406    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvdxl\" (UniqueName: \"kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-kube-api-access-fvdxl\") pod \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") "
Jul 06 19:46:50.221451 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221437    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istiod-ca-cert\") pod \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") "
Jul 06 19:46:50.221594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221460    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-podinfo\") pod \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") "
Jul 06 19:46:50.221594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221487    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-data\") pod \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") "
Jul 06 19:46:50.221594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221523    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-socket\") pod \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") "
Jul 06 19:46:50.221594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221544    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-envoy\") pod \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") "
Jul 06 19:46:50.221594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221558    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-token\") pod \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") "
Jul 06 19:46:50.221594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221576    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-certs\") pod \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") "
Jul 06 19:46:50.221914 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221613    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-credential-socket\") pod \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\" (UID: \"18e53fb8-d2a5-437e-9cb9-2ae88be57ede\") "
Jul 06 19:46:50.221914 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221806    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18e53fb8-d2a5-437e-9cb9-2ae88be57ede" (UID: "18e53fb8-d2a5-437e-9cb9-2ae88be57ede"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:46:50.221989 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.221968    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istiod-ca-cert\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:50.223095 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.222956    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18e53fb8-d2a5-437e-9cb9-2ae88be57ede" (UID: "18e53fb8-d2a5-437e-9cb9-2ae88be57ede"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:50.223095 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.223024    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18e53fb8-d2a5-437e-9cb9-2ae88be57ede" (UID: "18e53fb8-d2a5-437e-9cb9-2ae88be57ede"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:50.223254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.223103    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18e53fb8-d2a5-437e-9cb9-2ae88be57ede" (UID: "18e53fb8-d2a5-437e-9cb9-2ae88be57ede"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:50.223528 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.223484    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-data" (OuterVolumeSpecName: "istio-data") pod "18e53fb8-d2a5-437e-9cb9-2ae88be57ede" (UID: "18e53fb8-d2a5-437e-9cb9-2ae88be57ede"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:50.223786 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.223758    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-kube-api-access-fvdxl" (OuterVolumeSpecName: "kube-api-access-fvdxl") pod "18e53fb8-d2a5-437e-9cb9-2ae88be57ede" (UID: "18e53fb8-d2a5-437e-9cb9-2ae88be57ede"). InnerVolumeSpecName "kube-api-access-fvdxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:50.223902 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.223820    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18e53fb8-d2a5-437e-9cb9-2ae88be57ede" (UID: "18e53fb8-d2a5-437e-9cb9-2ae88be57ede"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:46:50.224697 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.224672    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-token" (OuterVolumeSpecName: "istio-token") pod "18e53fb8-d2a5-437e-9cb9-2ae88be57ede" (UID: "18e53fb8-d2a5-437e-9cb9-2ae88be57ede"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:46:50.224873 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.224855    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18e53fb8-d2a5-437e-9cb9-2ae88be57ede" (UID: "18e53fb8-d2a5-437e-9cb9-2ae88be57ede"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:46:50.323193 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.323150    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvdxl\" (UniqueName: \"kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-kube-api-access-fvdxl\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:50.323193 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.323186    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-podinfo\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:50.323193 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.323198    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-data\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:50.323432 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.323210    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:50.323432 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.323221    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-envoy\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:50.323432 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.323233    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-istio-token\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:50.323432 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.323243    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-workload-certs\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:50.323432 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.323255    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18e53fb8-d2a5-437e-9cb9-2ae88be57ede-credential-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:46:50.530749 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.530715    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"]
Jul 06 19:46:50.538164 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:50.538137    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-fb8958b1-openshift-default-68ffbf84ff-4wg7l"]
Jul 06 19:46:52.100010 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:52.099979    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18e53fb8-d2a5-437e-9cb9-2ae88be57ede" path="/var/lib/kubelet/pods/18e53fb8-d2a5-437e-9cb9-2ae88be57ede/volumes"
Jul 06 19:46:52.492512 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:52.492411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:52.594246 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:52.594189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:53.021902 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:53.021854    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:53.166947 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:53.166895    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:46:54.832369 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:46:54.832338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:00.891815 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:00.891783    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:01.041674 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:01.041637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:01.176072 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:01.175985    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:01.589935 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:01.589841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:27.578414 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:27.578374    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:33.700637 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:33.700600    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:33.827127 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:33.827094    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:33.975224 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:33.975146    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:49.870613 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:49.870578    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:55.804603 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:55.804565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:47:57.095536 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:47:57.095501    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:06.580247 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:06.580214    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:07.390600 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:07.390561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:13.409570 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:13.409535    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:13.518641 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:13.518597    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:13.741358 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:13.741271    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:13.961979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:13.961933    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:14.583210 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:14.583173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:14.706686 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:14.706642    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:16.376146 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:16.376109    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:22.613505 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:22.613418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:22.821123 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:22.821082    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:23.311452 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:23.311420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:30.181633 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.181592    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:30.280541 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.280505    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:30.409602 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.409570    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:30.739744 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.739696    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"]
Jul 06 19:48:30.740093 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.740080    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18e53fb8-d2a5-437e-9cb9-2ae88be57ede" containerName="istio-proxy"
Jul 06 19:48:30.740093 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.740094    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="18e53fb8-d2a5-437e-9cb9-2ae88be57ede" containerName="istio-proxy"
Jul 06 19:48:30.740180 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.740116    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00bbe430-8a12-4bba-bf07-9a5dbb460a3d" containerName="maas-api"
Jul 06 19:48:30.740180 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.740121    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="00bbe430-8a12-4bba-bf07-9a5dbb460a3d" containerName="maas-api"
Jul 06 19:48:30.740180 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.740169    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="18e53fb8-d2a5-437e-9cb9-2ae88be57ede" containerName="istio-proxy"
Jul 06 19:48:30.740180 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.740178    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="00bbe430-8a12-4bba-bf07-9a5dbb460a3d" containerName="maas-api"
Jul 06 19:48:30.743112 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.743097    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.754441 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.754423    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-281d3d44-openshift-default-dockercfg-nlzc6\""
Jul 06 19:48:30.808280 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.808241    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:30.824661 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.824626    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"]
Jul 06 19:48:30.838525 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.838491    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-certs\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.838689 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.838531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce96458-2400-413d-927c-e350e88e4f00-istio-podinfo\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.838689 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.838564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-envoy\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.838689 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.838599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-istio-token\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.838689 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.838641    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-data\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.838689 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.838669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-socket\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.838963 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.838768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-credential-socket\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.838963 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.838811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce96458-2400-413d-927c-e350e88e4f00-istiod-ca-cert\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.838963 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.838850    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpdt6\" (UniqueName: \"kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-kube-api-access-xpdt6\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.939977 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.939944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-certs\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.939977 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.939979    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce96458-2400-413d-927c-e350e88e4f00-istio-podinfo\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940231 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-envoy\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940231 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-istio-token\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940231 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-data\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940405 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-socket\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940405 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-credential-socket\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940405 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce96458-2400-413d-927c-e350e88e4f00-istiod-ca-cert\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940557 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpdt6\" (UniqueName: \"kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-kube-api-access-xpdt6\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940557 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940451    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-certs\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940667 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940554    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-data\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940667 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940634    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-socket\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.940808 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.940746    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-credential-socket\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.941085 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.941063    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce96458-2400-413d-927c-e350e88e4f00-istiod-ca-cert\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.942385 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.942354    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-envoy\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.942551 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.942528    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce96458-2400-413d-927c-e350e88e4f00-istio-podinfo\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.959339 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.959313    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-istio-token\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:30.960109 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:30.960079    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpdt6\" (UniqueName: \"kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-kube-api-access-xpdt6\") pod \"e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") " pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:31.052648 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:31.052560    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:31.171985 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:31.171949    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:31.215195 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:31.215172    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"]
Jul 06 19:48:31.216931 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:48:31.216901    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce96458_2400_413d_927c_e350e88e4f00.slice/crio-3d4ae582c5aa5e43bd23b23eb07cbc4c3b77d736fd043bb2e2f129441d847b1e WatchSource:0}: Error finding container 3d4ae582c5aa5e43bd23b23eb07cbc4c3b77d736fd043bb2e2f129441d847b1e: Status 404 returned error can't find the container with id 3d4ae582c5aa5e43bd23b23eb07cbc4c3b77d736fd043bb2e2f129441d847b1e
Jul 06 19:48:31.219078 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:31.219044    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:48:31.219153 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:31.219110    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:48:31.219153 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:31.219136    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:48:31.673919 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:31.673885    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" event={"ID":"5ce96458-2400-413d-927c-e350e88e4f00","Type":"ContainerStarted","Data":"c1af8e8e1df05b8af28c5bc2657f45030fc8b7ab6602713eaf7c4e2bb787ef2f"}
Jul 06 19:48:31.674098 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:31.673945    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" event={"ID":"5ce96458-2400-413d-927c-e350e88e4f00","Type":"ContainerStarted","Data":"3d4ae582c5aa5e43bd23b23eb07cbc4c3b77d736fd043bb2e2f129441d847b1e"}
Jul 06 19:48:31.699327 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:31.699280    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" podStartSLOduration=1.6992621319999999 podStartE2EDuration="1.699262132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:48:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:48:31.697646882 +0000 UTC m=+1716.070128626" watchObservedRunningTime="2026-07-06 19:48:31.699262132 +0000 UTC m=+1716.071743863"
Jul 06 19:48:32.053784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:32.053670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:32.059044 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:32.059019    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:32.678497 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:32.678467    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:32.679570 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:32.679552    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:33.288807 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.288773    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:33.673417 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.673382    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:33.785937 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.785908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:33.853584 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.853521    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"]
Jul 06 19:48:33.856911 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.856886    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:33.859416 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.859392    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-281d3d44-serving-cert\""
Jul 06 19:48:33.870787 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.870762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91af1173-421f-43ce-accc-2aec5b6e846b-openshift-service-ca\") pod \"maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") " pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:33.870991 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.870967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrxl4\" (UniqueName: \"kubernetes.io/projected/91af1173-421f-43ce-accc-2aec5b6e846b-kube-api-access-vrxl4\") pod \"maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") " pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:33.871059 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.871024    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91af1173-421f-43ce-accc-2aec5b6e846b-maas-api-tls\") pod \"maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") " pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:33.872068 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.872036    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"]
Jul 06 19:48:33.915089 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.915055    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:33.971895 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.971802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91af1173-421f-43ce-accc-2aec5b6e846b-openshift-service-ca\") pod \"maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") " pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:33.972053 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.971929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrxl4\" (UniqueName: \"kubernetes.io/projected/91af1173-421f-43ce-accc-2aec5b6e846b-kube-api-access-vrxl4\") pod \"maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") " pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:33.972053 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.971976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91af1173-421f-43ce-accc-2aec5b6e846b-maas-api-tls\") pod \"maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") " pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:33.972177 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:48:33.972121    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-281d3d44-serving-cert: secret "maas-api-e2e-mt-281d3d44-serving-cert" not found
Jul 06 19:48:33.972232 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:48:33.972190    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91af1173-421f-43ce-accc-2aec5b6e846b-maas-api-tls podName:91af1173-421f-43ce-accc-2aec5b6e846b nodeName:}" failed. No retries permitted until 2026-07-06 19:48:34.472170977 +0000 UTC m=+1718.844652691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/91af1173-421f-43ce-accc-2aec5b6e846b-maas-api-tls") pod "maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk" (UID: "91af1173-421f-43ce-accc-2aec5b6e846b") : secret "maas-api-e2e-mt-281d3d44-serving-cert" not found
Jul 06 19:48:33.972581 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.972557    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91af1173-421f-43ce-accc-2aec5b6e846b-openshift-service-ca\") pod \"maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") " pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:33.983278 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:33.983248    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrxl4\" (UniqueName: \"kubernetes.io/projected/91af1173-421f-43ce-accc-2aec5b6e846b-kube-api-access-vrxl4\") pod \"maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") " pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:34.392717 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:34.392655    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:34.477270 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:34.477239    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91af1173-421f-43ce-accc-2aec5b6e846b-maas-api-tls\") pod \"maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") " pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:34.479808 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:34.479783    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91af1173-421f-43ce-accc-2aec5b6e846b-maas-api-tls\") pod \"maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") " pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:34.608859 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:34.608825    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:34.708289 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:34.708204    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:34.768061 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:34.768031    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:34.916655 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:34.916622    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"]
Jul 06 19:48:34.917684 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:48:34.917659    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91af1173_421f_43ce_accc_2aec5b6e846b.slice/crio-223571c52ef1920a015808d611b30675ac2ad88bed0614e5a5810f5350b6395c WatchSource:0}: Error finding container 223571c52ef1920a015808d611b30675ac2ad88bed0614e5a5810f5350b6395c: Status 404 returned error can't find the container with id 223571c52ef1920a015808d611b30675ac2ad88bed0614e5a5810f5350b6395c
Jul 06 19:48:35.696561 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:35.696473    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk" event={"ID":"91af1173-421f-43ce-accc-2aec5b6e846b","Type":"ContainerStarted","Data":"2451312854d30d5f93c02ba7462cc3a3de9f274f9df378ddbe8c118d1ad41208"}
Jul 06 19:48:35.696561 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:35.696521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk" event={"ID":"91af1173-421f-43ce-accc-2aec5b6e846b","Type":"ContainerStarted","Data":"223571c52ef1920a015808d611b30675ac2ad88bed0614e5a5810f5350b6395c"}
Jul 06 19:48:35.696795 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:35.696587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:38.156791 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:38.156755    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:38.822266 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:38.822227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:38.921285 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:38.921247    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:39.294847 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:39.294817    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:41.706427 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:41.706395    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:41.727955 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:41.727906    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk" podStartSLOduration=8.203203551 podStartE2EDuration="8.727892398s" totalImagesPullingTime="524.688847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:48:35.726941696 +0000 UTC m=+1720.099423428" watchObservedRunningTime="2026-07-06 19:48:41.727892398 +0000 UTC m=+1726.100374130"
Jul 06 19:48:45.728315 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:45.728275    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:45.811926 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:45.811888    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:46.243389 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.243354    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:46.603968 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.603933    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"]
Jul 06 19:48:46.604192 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.604160    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk" podUID="91af1173-421f-43ce-accc-2aec5b6e846b" containerName="maas-api" containerID="cri-o://2451312854d30d5f93c02ba7462cc3a3de9f274f9df378ddbe8c118d1ad41208" gracePeriod=30
Jul 06 19:48:46.635093 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.635059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:46.701915 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.701867    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk" podUID="91af1173-421f-43ce-accc-2aec5b6e846b" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.48:8443/health\": dial tcp 10.133.0.48:8443: connect: connection refused"
Jul 06 19:48:46.733644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.733607    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:46.750410 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.750376    2579 generic.go:356] "Generic (PLEG): container finished" podID="91af1173-421f-43ce-accc-2aec5b6e846b" containerID="2451312854d30d5f93c02ba7462cc3a3de9f274f9df378ddbe8c118d1ad41208" exitCode=0
Jul 06 19:48:46.750573 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.750442    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk" event={"ID":"91af1173-421f-43ce-accc-2aec5b6e846b","Type":"ContainerDied","Data":"2451312854d30d5f93c02ba7462cc3a3de9f274f9df378ddbe8c118d1ad41208"}
Jul 06 19:48:46.860866 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.860794    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:46.895993 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.895962    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrxl4\" (UniqueName: \"kubernetes.io/projected/91af1173-421f-43ce-accc-2aec5b6e846b-kube-api-access-vrxl4\") pod \"91af1173-421f-43ce-accc-2aec5b6e846b\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") "
Jul 06 19:48:46.896172 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.896007    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91af1173-421f-43ce-accc-2aec5b6e846b-maas-api-tls\") pod \"91af1173-421f-43ce-accc-2aec5b6e846b\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") "
Jul 06 19:48:46.896172 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.896113    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91af1173-421f-43ce-accc-2aec5b6e846b-openshift-service-ca\") pod \"91af1173-421f-43ce-accc-2aec5b6e846b\" (UID: \"91af1173-421f-43ce-accc-2aec5b6e846b\") "
Jul 06 19:48:46.896479 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.896455    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91af1173-421f-43ce-accc-2aec5b6e846b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "91af1173-421f-43ce-accc-2aec5b6e846b" (UID: "91af1173-421f-43ce-accc-2aec5b6e846b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:48:46.898165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.898140    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91af1173-421f-43ce-accc-2aec5b6e846b-kube-api-access-vrxl4" (OuterVolumeSpecName: "kube-api-access-vrxl4") pod "91af1173-421f-43ce-accc-2aec5b6e846b" (UID: "91af1173-421f-43ce-accc-2aec5b6e846b"). InnerVolumeSpecName "kube-api-access-vrxl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:48:46.898594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.898577    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91af1173-421f-43ce-accc-2aec5b6e846b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "91af1173-421f-43ce-accc-2aec5b6e846b" (UID: "91af1173-421f-43ce-accc-2aec5b6e846b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:48:46.997928 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.997888    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrxl4\" (UniqueName: \"kubernetes.io/projected/91af1173-421f-43ce-accc-2aec5b6e846b-kube-api-access-vrxl4\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:46.997928 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.997930    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91af1173-421f-43ce-accc-2aec5b6e846b-maas-api-tls\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:46.998186 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:46.997946    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91af1173-421f-43ce-accc-2aec5b6e846b-openshift-service-ca\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:47.756915 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:47.756877    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk" event={"ID":"91af1173-421f-43ce-accc-2aec5b6e846b","Type":"ContainerDied","Data":"223571c52ef1920a015808d611b30675ac2ad88bed0614e5a5810f5350b6395c"}
Jul 06 19:48:47.757424 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:47.756934    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"
Jul 06 19:48:47.757424 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:47.756937    2579 scope.go:117] "RemoveContainer" containerID="2451312854d30d5f93c02ba7462cc3a3de9f274f9df378ddbe8c118d1ad41208"
Jul 06 19:48:47.784660 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:47.784632    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"]
Jul 06 19:48:47.786625 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:47.786604    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-281d3d44-68cccb8b85-dg9xk"]
Jul 06 19:48:47.913301 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:47.912343    2579 patch_prober.go:28] interesting pod/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:48812->10.133.0.47:15021: read: connection reset by peer" start-of-body=
Jul 06 19:48:47.913301 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:47.912418    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:48812->10.133.0.47:15021: read: connection reset by peer"
Jul 06 19:48:48.099363 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:48.099336    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91af1173-421f-43ce-accc-2aec5b6e846b" path="/var/lib/kubelet/pods/91af1173-421f-43ce-accc-2aec5b6e846b/volumes"
Jul 06 19:48:48.763793 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:48.763759    2579 generic.go:356] "Generic (PLEG): container finished" podID="5ce96458-2400-413d-927c-e350e88e4f00" containerID="c1af8e8e1df05b8af28c5bc2657f45030fc8b7ab6602713eaf7c4e2bb787ef2f" exitCode=0
Jul 06 19:48:48.764221 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:48.763831    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" event={"ID":"5ce96458-2400-413d-927c-e350e88e4f00","Type":"ContainerDied","Data":"c1af8e8e1df05b8af28c5bc2657f45030fc8b7ab6602713eaf7c4e2bb787ef2f"}
Jul 06 19:48:48.764221 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:48.764215    2579 scope.go:117] "RemoveContainer" containerID="c1af8e8e1df05b8af28c5bc2657f45030fc8b7ab6602713eaf7c4e2bb787ef2f"
Jul 06 19:48:48.765211 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:48.765185    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:48:48.765277 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:48.765253    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:48:48.765318 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:48.765285    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:48:49.319262 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:49.319224    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:49.518099 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:49.518029    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:49.774514 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:49.774467    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" event={"ID":"5ce96458-2400-413d-927c-e350e88e4f00","Type":"ContainerStarted","Data":"7f532036bea79b1463d619468b0cb7c99f66a5aacb8d20f310db1773c5c4aef3"}
Jul 06 19:48:50.053195 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:50.053111    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:50.053396 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:50.053375    2579 patch_prober.go:28] interesting pod/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 06 19:48:50.053445 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:50.053420    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 06 19:48:51.053113 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:51.053078    2579 patch_prober.go:28] interesting pod/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 06 19:48:51.053494 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:51.053142    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 06 19:48:52.053170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:52.053127    2579 patch_prober.go:28] interesting pod/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 06 19:48:52.053649 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:52.053597    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 06 19:48:53.053688 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:53.053646    2579 patch_prober.go:28] interesting pod/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 06 19:48:53.054241 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:53.053736    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 06 19:48:53.141854 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:53.141812    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:53.328012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:53.327914    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:53.450811 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:53.450779    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"]
Jul 06 19:48:53.450997 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:53.450955    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy" containerID="cri-o://7f532036bea79b1463d619468b0cb7c99f66a5aacb8d20f310db1773c5c4aef3" gracePeriod=30
Jul 06 19:48:53.515655 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:53.515605    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:53.679691 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:53.679652    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:53.821155 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:53.821121    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:53.994299 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:53.994210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:54.105769 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:54.105734    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:48:58.819679 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:58.819644    2579 generic.go:356] "Generic (PLEG): container finished" podID="5ce96458-2400-413d-927c-e350e88e4f00" containerID="7f532036bea79b1463d619468b0cb7c99f66a5aacb8d20f310db1773c5c4aef3" exitCode=0
Jul 06 19:48:58.820038 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:58.819680    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" event={"ID":"5ce96458-2400-413d-927c-e350e88e4f00","Type":"ContainerDied","Data":"7f532036bea79b1463d619468b0cb7c99f66a5aacb8d20f310db1773c5c4aef3"}
Jul 06 19:48:58.820038 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:58.819759    2579 scope.go:117] "RemoveContainer" containerID="c1af8e8e1df05b8af28c5bc2657f45030fc8b7ab6602713eaf7c4e2bb787ef2f"
Jul 06 19:48:58.904503 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:58.904481    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:59.009109 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009029    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-istio-token\") pod \"5ce96458-2400-413d-927c-e350e88e4f00\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") "
Jul 06 19:48:59.009109 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009064    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-data\") pod \"5ce96458-2400-413d-927c-e350e88e4f00\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") "
Jul 06 19:48:59.009109 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009086    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce96458-2400-413d-927c-e350e88e4f00-istiod-ca-cert\") pod \"5ce96458-2400-413d-927c-e350e88e4f00\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") "
Jul 06 19:48:59.009349 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009268    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-socket\") pod \"5ce96458-2400-413d-927c-e350e88e4f00\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") "
Jul 06 19:48:59.009349 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009324    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-credential-socket\") pod \"5ce96458-2400-413d-927c-e350e88e4f00\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") "
Jul 06 19:48:59.009456 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009369    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-certs\") pod \"5ce96458-2400-413d-927c-e350e88e4f00\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") "
Jul 06 19:48:59.009456 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009396    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpdt6\" (UniqueName: \"kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-kube-api-access-xpdt6\") pod \"5ce96458-2400-413d-927c-e350e88e4f00\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") "
Jul 06 19:48:59.009456 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009432    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce96458-2400-413d-927c-e350e88e4f00-istio-podinfo\") pod \"5ce96458-2400-413d-927c-e350e88e4f00\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") "
Jul 06 19:48:59.009623 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009453    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ce96458-2400-413d-927c-e350e88e4f00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ce96458-2400-413d-927c-e350e88e4f00" (UID: "5ce96458-2400-413d-927c-e350e88e4f00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:48:59.009623 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009461    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-envoy\") pod \"5ce96458-2400-413d-927c-e350e88e4f00\" (UID: \"5ce96458-2400-413d-927c-e350e88e4f00\") "
Jul 06 19:48:59.009623 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009497    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ce96458-2400-413d-927c-e350e88e4f00" (UID: "5ce96458-2400-413d-927c-e350e88e4f00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:48:59.009804 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009642    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ce96458-2400-413d-927c-e350e88e4f00" (UID: "5ce96458-2400-413d-927c-e350e88e4f00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:48:59.009899 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009877    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ce96458-2400-413d-927c-e350e88e4f00-istiod-ca-cert\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:59.009971 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009955    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:59.010034 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009977    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-credential-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:59.010034 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009981    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ce96458-2400-413d-927c-e350e88e4f00" (UID: "5ce96458-2400-413d-927c-e350e88e4f00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:48:59.010034 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.009993    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ce96458-2400-413d-927c-e350e88e4f00" (UID: "5ce96458-2400-413d-927c-e350e88e4f00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:48:59.011759 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.011722    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ce96458-2400-413d-927c-e350e88e4f00" (UID: "5ce96458-2400-413d-927c-e350e88e4f00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:48:59.011854 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.011825    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-kube-api-access-xpdt6" (OuterVolumeSpecName: "kube-api-access-xpdt6") pod "5ce96458-2400-413d-927c-e350e88e4f00" (UID: "5ce96458-2400-413d-927c-e350e88e4f00"). InnerVolumeSpecName "kube-api-access-xpdt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:48:59.011988 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.011958    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ce96458-2400-413d-927c-e350e88e4f00" (UID: "5ce96458-2400-413d-927c-e350e88e4f00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:48:59.012085 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.012012    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ce96458-2400-413d-927c-e350e88e4f00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ce96458-2400-413d-927c-e350e88e4f00" (UID: "5ce96458-2400-413d-927c-e350e88e4f00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:48:59.111213 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.111182    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-istio-token\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:59.111213 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.111207    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-data\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:59.111213 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.111216    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-workload-certs\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:59.111434 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.111224    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpdt6\" (UniqueName: \"kubernetes.io/projected/5ce96458-2400-413d-927c-e350e88e4f00-kube-api-access-xpdt6\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:59.111434 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.111235    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ce96458-2400-413d-927c-e350e88e4f00-istio-podinfo\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:59.111434 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.111243    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ce96458-2400-413d-927c-e350e88e4f00-istio-envoy\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:48:59.825527 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.825486    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf" event={"ID":"5ce96458-2400-413d-927c-e350e88e4f00","Type":"ContainerDied","Data":"3d4ae582c5aa5e43bd23b23eb07cbc4c3b77d736fd043bb2e2f129441d847b1e"}
Jul 06 19:48:59.826024 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.825553    2579 scope.go:117] "RemoveContainer" containerID="7f532036bea79b1463d619468b0cb7c99f66a5aacb8d20f310db1773c5c4aef3"
Jul 06 19:48:59.826024 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.825508    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"
Jul 06 19:48:59.859834 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.859800    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"]
Jul 06 19:48:59.871171 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:48:59.871145    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-281d3d44-openshift-default-6749c5b459-krxbf"]
Jul 06 19:49:00.099878 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:00.099852    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ce96458-2400-413d-927c-e350e88e4f00" path="/var/lib/kubelet/pods/5ce96458-2400-413d-927c-e350e88e4f00/volumes"
Jul 06 19:49:01.499576 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:01.499541    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:01.637358 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:01.637330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:01.872479 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:01.872444    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:02.008474 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:02.008442    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:08.299200 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:08.299164    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:08.480165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:08.480136    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:15.271586 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.271550    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:15.579129 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.579035    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"]
Jul 06 19:49:15.579423 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.579406    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy"
Jul 06 19:49:15.579423 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.579426    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy"
Jul 06 19:49:15.579423 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.579440    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91af1173-421f-43ce-accc-2aec5b6e846b" containerName="maas-api"
Jul 06 19:49:15.579423 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.579452    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="91af1173-421f-43ce-accc-2aec5b6e846b" containerName="maas-api"
Jul 06 19:49:15.579653 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.579486    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy"
Jul 06 19:49:15.579653 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.579495    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy"
Jul 06 19:49:15.579653 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.579590    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy"
Jul 06 19:49:15.579653 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.579609    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="91af1173-421f-43ce-accc-2aec5b6e846b" containerName="maas-api"
Jul 06 19:49:15.583990 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.583966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.590955 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.590384    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-78d446d5-openshift-default-dockercfg-wbt44\""
Jul 06 19:49:15.607666 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.607632    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"]
Jul 06 19:49:15.633216 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.633186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:15.664809 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.664768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-token\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.665012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.664821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-socket\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.665012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.664896    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-credential-socket\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.665012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.664926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-certs\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.665012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.664983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istiod-ca-cert\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.665012 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.665005    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv7r4\" (UniqueName: \"kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-kube-api-access-kv7r4\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.665253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.665045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-envoy\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.665253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.665073    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-podinfo\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.665253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.665122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-data\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.725040 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.725001    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:15.766083 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-data\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.766083 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-token\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.766615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-socket\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.766615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-credential-socket\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.766615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-certs\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.766615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istiod-ca-cert\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.766615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv7r4\" (UniqueName: \"kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-kube-api-access-kv7r4\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.766615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-envoy\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.766615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766446    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-data\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.766615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-podinfo\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.766615 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766499    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-socket\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.767020 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766854    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-certs\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.767020 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.766904    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-credential-socket\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.767344 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.767321    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istiod-ca-cert\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.768814 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.768791    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-envoy\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.769165 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.769147    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-podinfo\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.783334 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.783295    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-token\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.783473 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.783395    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv7r4\" (UniqueName: \"kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-kube-api-access-kv7r4\") pod \"e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") " pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:15.894821 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:15.894784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:16.042853 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:16.042828    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"]
Jul 06 19:49:16.044156 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:49:16.044134    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f40f37b_ca3b_4d13_88d0_e408df7a9bbc.slice/crio-20c312b4d11d10375ab27cb07cd4e8a490c9a85970036839de462a6380e0a8d2 WatchSource:0}: Error finding container 20c312b4d11d10375ab27cb07cd4e8a490c9a85970036839de462a6380e0a8d2: Status 404 returned error can't find the container with id 20c312b4d11d10375ab27cb07cd4e8a490c9a85970036839de462a6380e0a8d2
Jul 06 19:49:16.046167 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:16.046139    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:49:16.046235 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:16.046198    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:49:16.046235 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:16.046226    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:49:16.905636 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:16.905604    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" event={"ID":"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc","Type":"ContainerStarted","Data":"082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8"}
Jul 06 19:49:16.906105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:16.905662    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" event={"ID":"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc","Type":"ContainerStarted","Data":"20c312b4d11d10375ab27cb07cd4e8a490c9a85970036839de462a6380e0a8d2"}
Jul 06 19:49:16.936067 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:16.936020    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" podStartSLOduration=1.93600433 podStartE2EDuration="1.93600433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:49:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:49:16.934782102 +0000 UTC m=+1761.307263835" watchObservedRunningTime="2026-07-06 19:49:16.93600433 +0000 UTC m=+1761.308486061"
Jul 06 19:49:17.895329 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:17.895288    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:17.900362 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:17.900338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:17.910644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:17.910624    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:17.911416 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:17.911395    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:18.980268 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:18.980227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:19.056997 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.056965    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"]
Jul 06 19:49:19.057371 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.057359    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ce96458-2400-413d-927c-e350e88e4f00" containerName="istio-proxy"
Jul 06 19:49:19.060480 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.060461    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.063173 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.063156    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-78d446d5-serving-cert\""
Jul 06 19:49:19.079162 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.079130    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"]
Jul 06 19:49:19.091148 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.091123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-maas-api-tls\") pod \"maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") " pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.091289 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.091187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgd5\" (UniqueName: \"kubernetes.io/projected/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-kube-api-access-zrgd5\") pod \"maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") " pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.091289 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.091240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-openshift-service-ca\") pod \"maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") " pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.107427 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.107394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:19.191781 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.191743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-maas-api-tls\") pod \"maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") " pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.191987 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.191819    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgd5\" (UniqueName: \"kubernetes.io/projected/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-kube-api-access-zrgd5\") pod \"maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") " pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.191987 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.191869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-openshift-service-ca\") pod \"maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") " pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.192529 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.192508    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-openshift-service-ca\") pod \"maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") " pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.194178 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.194157    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-maas-api-tls\") pod \"maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") " pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.198467 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.198436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:19.205093 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.205068    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgd5\" (UniqueName: \"kubernetes.io/projected/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-kube-api-access-zrgd5\") pod \"maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") " pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.298839 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.298760    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:19.370667 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.370625    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:19.519673 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.519646    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"]
Jul 06 19:49:19.522046 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:49:19.522017    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e06f6dc_c4dd_4354_b201_0869d6bb47e4.slice/crio-e60516e9487ba0036e9d3ecbbb60249180d43dc3d5f81de331fd6f0dc0c54bcf WatchSource:0}: Error finding container e60516e9487ba0036e9d3ecbbb60249180d43dc3d5f81de331fd6f0dc0c54bcf: Status 404 returned error can't find the container with id e60516e9487ba0036e9d3ecbbb60249180d43dc3d5f81de331fd6f0dc0c54bcf
Jul 06 19:49:19.737158 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.737124    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:19.903346 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.903313    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:19.921532 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:19.921492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr" event={"ID":"8e06f6dc-c4dd-4354-b201-0869d6bb47e4","Type":"ContainerStarted","Data":"e60516e9487ba0036e9d3ecbbb60249180d43dc3d5f81de331fd6f0dc0c54bcf"}
Jul 06 19:49:20.928672 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:20.928639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr" event={"ID":"8e06f6dc-c4dd-4354-b201-0869d6bb47e4","Type":"ContainerStarted","Data":"f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb"}
Jul 06 19:49:20.929087 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:20.928729    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:20.948816 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:20.948759    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr" podStartSLOduration=1.53130064 podStartE2EDuration="1.948739457s" totalImagesPullingTime="417.438817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:49:20.947186632 +0000 UTC m=+1765.319668386" watchObservedRunningTime="2026-07-06 19:49:20.948739457 +0000 UTC m=+1765.321221191"
Jul 06 19:49:23.472619 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:23.472576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:26.938938 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:26.938912    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:49:31.986550 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:31.986520    2579 generic.go:356] "Generic (PLEG): container finished" podID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerID="082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8" exitCode=0
Jul 06 19:49:31.986973 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:31.986595    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" event={"ID":"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc","Type":"ContainerDied","Data":"082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8"}
Jul 06 19:49:31.987035 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:31.987020    2579 scope.go:117] "RemoveContainer" containerID="082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8"
Jul 06 19:49:31.987995 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:31.987966    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:49:31.988054 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:31.988040    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:49:31.988093 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:31.988070    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:49:32.911458 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:32.911430    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:32.993399 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:32.993356    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" event={"ID":"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc","Type":"ContainerStarted","Data":"7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04"}
Jul 06 19:49:33.894914 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:33.894878    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:33.896188 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:33.896163    2579 patch_prober.go:28] interesting pod/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 19:49:33.896311 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:33.896223    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 19:49:34.006185 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:34.006151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:49:34.895628 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:34.895584    2579 patch_prober.go:28] interesting pod/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 19:49:34.895840 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:34.895647    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 19:49:35.895490 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:35.895451    2579 patch_prober.go:28] interesting pod/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 19:49:35.895930 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:35.895526    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 19:49:36.895812 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:36.895775    2579 patch_prober.go:28] interesting pod/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 06 19:49:36.896218 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:36.895845    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 06 19:49:37.899745 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:37.899687    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:37.900211 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:37.900162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:49:37.901023 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:49:37.901001    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:50:06.595356 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:06.595318    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:07.139252 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.139218    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"]
Jul 06 19:50:07.139436 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.139415    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr" podUID="8e06f6dc-c4dd-4354-b201-0869d6bb47e4" containerName="maas-api" containerID="cri-o://f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb" gracePeriod=30
Jul 06 19:50:07.180528 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.180486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:07.386925 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.386896    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:50:07.462262 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.462170    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrgd5\" (UniqueName: \"kubernetes.io/projected/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-kube-api-access-zrgd5\") pod \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") "
Jul 06 19:50:07.462262 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.462229    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-openshift-service-ca\") pod \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") "
Jul 06 19:50:07.462262 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.462254    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-maas-api-tls\") pod \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\" (UID: \"8e06f6dc-c4dd-4354-b201-0869d6bb47e4\") "
Jul 06 19:50:07.462607 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.462581    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e06f6dc-c4dd-4354-b201-0869d6bb47e4" (UID: "8e06f6dc-c4dd-4354-b201-0869d6bb47e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:50:07.464360 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.464333    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-kube-api-access-zrgd5" (OuterVolumeSpecName: "kube-api-access-zrgd5") pod "8e06f6dc-c4dd-4354-b201-0869d6bb47e4" (UID: "8e06f6dc-c4dd-4354-b201-0869d6bb47e4"). InnerVolumeSpecName "kube-api-access-zrgd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:50:07.464360 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.464348    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e06f6dc-c4dd-4354-b201-0869d6bb47e4" (UID: "8e06f6dc-c4dd-4354-b201-0869d6bb47e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:50:07.563542 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.563505    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrgd5\" (UniqueName: \"kubernetes.io/projected/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-kube-api-access-zrgd5\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:50:07.563542 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.563536    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-openshift-service-ca\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:50:07.563542 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:07.563547    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e06f6dc-c4dd-4354-b201-0869d6bb47e4-maas-api-tls\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:50:08.165826 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:08.165793    2579 generic.go:356] "Generic (PLEG): container finished" podID="8e06f6dc-c4dd-4354-b201-0869d6bb47e4" containerID="f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb" exitCode=0
Jul 06 19:50:08.166265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:08.165852    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"
Jul 06 19:50:08.166265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:08.165885    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr" event={"ID":"8e06f6dc-c4dd-4354-b201-0869d6bb47e4","Type":"ContainerDied","Data":"f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb"}
Jul 06 19:50:08.166265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:08.165950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr" event={"ID":"8e06f6dc-c4dd-4354-b201-0869d6bb47e4","Type":"ContainerDied","Data":"e60516e9487ba0036e9d3ecbbb60249180d43dc3d5f81de331fd6f0dc0c54bcf"}
Jul 06 19:50:08.166265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:08.165978    2579 scope.go:117] "RemoveContainer" containerID="f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb"
Jul 06 19:50:08.174819 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:08.174800    2579 scope.go:117] "RemoveContainer" containerID="f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb"
Jul 06 19:50:08.175065 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:50:08.175046    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb\": container with ID starting with f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb not found: ID does not exist" containerID="f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb"
Jul 06 19:50:08.175118 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:08.175072    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb"} err="failed to get container status \"f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb\": rpc error: code = NotFound desc = could not find container \"f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb\": container with ID starting with f07ff009002ca37375729ff0324552743d8e21d3fc81d941338ca8bba101d9fb not found: ID does not exist"
Jul 06 19:50:08.208088 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:08.208055    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"]
Jul 06 19:50:08.214871 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:08.214846    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-78d446d5-5bc98f9f9-gplmr"]
Jul 06 19:50:10.099649 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:10.099606    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e06f6dc-c4dd-4354-b201-0869d6bb47e4" path="/var/lib/kubelet/pods/8e06f6dc-c4dd-4354-b201-0869d6bb47e4/volumes"
Jul 06 19:50:12.619534 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:12.619501    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:17.724204 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:17.724148    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:53.796107 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:53.796070    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:50:54.793082 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:50:54.793039    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:00.567173 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:00.567131    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:00.651025 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:00.650987    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:00.874655 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:00.874623    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"]
Jul 06 19:51:00.874924 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:00.874885    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy" containerID="cri-o://7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04" gracePeriod=30
Jul 06 19:51:01.042230 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:01.042191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:01.142376 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:01.142286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:02.254143 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:02.254097    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:02.349090 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:02.349055    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:02.451970 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:02.451930    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:03.289681 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:03.289650    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:03.391200 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:03.391163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:03.490990 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:03.490951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:05.036766 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:05.036727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:06.132090 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.132065    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:51:06.194106 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194017    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-credential-socket\") pod \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") "
Jul 06 19:51:06.194106 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194050    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istiod-ca-cert\") pod \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") "
Jul 06 19:51:06.194106 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194075    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-socket\") pod \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") "
Jul 06 19:51:06.194106 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194103    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-podinfo\") pod \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") "
Jul 06 19:51:06.194414 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194139    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv7r4\" (UniqueName: \"kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-kube-api-access-kv7r4\") pod \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") "
Jul 06 19:51:06.194414 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194235    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-token\") pod \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") "
Jul 06 19:51:06.194414 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194262    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-certs\") pod \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") "
Jul 06 19:51:06.194414 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194290    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-envoy\") pod \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") "
Jul 06 19:51:06.194414 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194338    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-data\") pod \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\" (UID: \"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc\") "
Jul 06 19:51:06.194414 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194354    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" (UID: "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:06.194665 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194432    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" (UID: "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:06.194665 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194622    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" (UID: "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:06.194823 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194686    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:51:06.194823 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194692    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" (UID: "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:51:06.194823 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194744    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-workload-certs\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:51:06.194823 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.194757    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-credential-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:51:06.195357 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.195329    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" (UID: "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:06.196472 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.196443    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-kube-api-access-kv7r4" (OuterVolumeSpecName: "kube-api-access-kv7r4") pod "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" (UID: "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc"). InnerVolumeSpecName "kube-api-access-kv7r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:51:06.196570 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.196485    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" (UID: "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:51:06.196748 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.196725    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" (UID: "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:51:06.196862 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.196839    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" (UID: "5f40f37b-ca3b-4d13-88d0-e408df7a9bbc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:51:06.295621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.295584    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-data\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:51:06.295621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.295621    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istiod-ca-cert\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:51:06.295621 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.295630    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-podinfo\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:51:06.295874 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.295639    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv7r4\" (UniqueName: \"kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-kube-api-access-kv7r4\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:51:06.295874 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.295651    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-token\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:51:06.295874 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.295663    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc-istio-envoy\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:51:06.441849 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.441815    2579 generic.go:356] "Generic (PLEG): container finished" podID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerID="7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04" exitCode=0
Jul 06 19:51:06.442019 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.441868    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"
Jul 06 19:51:06.442019 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.441901    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" event={"ID":"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc","Type":"ContainerDied","Data":"7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04"}
Jul 06 19:51:06.442019 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.441962    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp" event={"ID":"5f40f37b-ca3b-4d13-88d0-e408df7a9bbc","Type":"ContainerDied","Data":"20c312b4d11d10375ab27cb07cd4e8a490c9a85970036839de462a6380e0a8d2"}
Jul 06 19:51:06.442019 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.441993    2579 scope.go:117] "RemoveContainer" containerID="7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04"
Jul 06 19:51:06.451908 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.451841    2579 scope.go:117] "RemoveContainer" containerID="082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8"
Jul 06 19:51:06.462869 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.462848    2579 scope.go:117] "RemoveContainer" containerID="7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04"
Jul 06 19:51:06.463124 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:51:06.463105    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04\": container with ID starting with 7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04 not found: ID does not exist" containerID="7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04"
Jul 06 19:51:06.463173 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.463132    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04"} err="failed to get container status \"7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04\": rpc error: code = NotFound desc = could not find container \"7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04\": container with ID starting with 7ebb55865994f7c6ea76a75acea8e736031666a65e202f2fd2dce5e305993e04 not found: ID does not exist"
Jul 06 19:51:06.463173 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.463149    2579 scope.go:117] "RemoveContainer" containerID="082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8"
Jul 06 19:51:06.463395 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:51:06.463375    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8\": container with ID starting with 082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8 not found: ID does not exist" containerID="082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8"
Jul 06 19:51:06.463481 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.463402    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8"} err="failed to get container status \"082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8\": rpc error: code = NotFound desc = could not find container \"082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8\": container with ID starting with 082b5d07099e7d11dd0fc7c2d6effbb4f4fb32061a047385f08e2613b0f5a6b8 not found: ID does not exist"
Jul 06 19:51:06.466010 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.465988    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"]
Jul 06 19:51:06.471323 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:06.471296    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-78d446d5-openshift-default-7fcd8b99bc-z7bxp"]
Jul 06 19:51:08.104433 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:08.104396    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" path="/var/lib/kubelet/pods/5f40f37b-ca3b-4d13-88d0-e408df7a9bbc/volumes"
Jul 06 19:51:11.221104 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:11.221066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:11.330860 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:11.330825    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:12.025310 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:12.025272    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:19.689343 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:19.689251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:19.896092 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:19.896052    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:19.992650 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:19.992560    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:30.485501 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:30.485455    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:30.949390 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:30.949304    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:31.564794 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:31.564753    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:31.689261 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:31.689216    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:51.968459 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:51.968419    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:59.422189 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:59.422153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:59.575160 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:59.575127    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:51:59.845476 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:51:59.845384    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:00.208749 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.208716    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"]
Jul 06 19:52:00.209067 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.209055    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy"
Jul 06 19:52:00.209114 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.209069    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy"
Jul 06 19:52:00.209114 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.209084    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e06f6dc-c4dd-4354-b201-0869d6bb47e4" containerName="maas-api"
Jul 06 19:52:00.209114 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.209089    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e06f6dc-c4dd-4354-b201-0869d6bb47e4" containerName="maas-api"
Jul 06 19:52:00.209211 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.209150    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy"
Jul 06 19:52:00.209211 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.209157    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e06f6dc-c4dd-4354-b201-0869d6bb47e4" containerName="maas-api"
Jul 06 19:52:00.209211 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.209166    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy"
Jul 06 19:52:00.212355 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.212337    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.215401 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.215380    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-905adb-openshift-default-dockercfg-6cvn2\""
Jul 06 19:52:00.217254 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.217225    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:00.257937 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.257907    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"]
Jul 06 19:52:00.270818 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.270789    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-credential-socket\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.270979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.270823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-podinfo\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.270979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.270866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9w4j\" (UniqueName: \"kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-kube-api-access-b9w4j\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.270979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.270892    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-envoy\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.270979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.270924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-data\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.271147 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.271010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-token\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.271147 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.271039    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istiod-ca-cert\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.271147 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.271061    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-socket\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.271147 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.271113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-certs\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.371644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.371605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-credential-socket\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.371644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.371647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-podinfo\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.371916 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.371676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9w4j\" (UniqueName: \"kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-kube-api-access-b9w4j\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.371916 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.371693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-envoy\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.371916 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.371736    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-data\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.371916 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.371772    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-token\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.371916 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.371789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istiod-ca-cert\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.371916 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.371806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-socket\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.371916 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.371838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-certs\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.372279 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.372106    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-credential-socket\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.372279 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.372162    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-data\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.372279 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.372260    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-socket\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.372400 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.372283    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-certs\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.372525 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.372505    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istiod-ca-cert\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.374128 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.374106    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-envoy\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.374428 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.374407    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-podinfo\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.383919 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.383892    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:00.386408 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.386375    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-token\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.386521 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.386504    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9w4j\" (UniqueName: \"kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-kube-api-access-b9w4j\") pod \"e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") " pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.523666 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.523551    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:00.670364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.670335    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"]
Jul 06 19:52:00.672252 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:52:00.672228    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7d05857_d8b2_4b1f_bd9c_1c0d6b978250.slice/crio-a0f6c4b080e0f41ac0418d1b163e0616800a8d4fdd53ad45bf05dbf20ecb473c WatchSource:0}: Error finding container a0f6c4b080e0f41ac0418d1b163e0616800a8d4fdd53ad45bf05dbf20ecb473c: Status 404 returned error can't find the container with id a0f6c4b080e0f41ac0418d1b163e0616800a8d4fdd53ad45bf05dbf20ecb473c
Jul 06 19:52:00.674253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.674223    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:52:00.674346 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.674301    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:52:00.674406 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.674346    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:52:00.695751 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:00.695698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" event={"ID":"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250","Type":"ContainerStarted","Data":"a0f6c4b080e0f41ac0418d1b163e0616800a8d4fdd53ad45bf05dbf20ecb473c"}
Jul 06 19:52:01.702127 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:01.702094    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" event={"ID":"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250","Type":"ContainerStarted","Data":"a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a"}
Jul 06 19:52:01.732661 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:01.732610    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" podStartSLOduration=1.7325924160000001 podStartE2EDuration="1.732592416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:52:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:01.732037459 +0000 UTC m=+1926.104519204" watchObservedRunningTime="2026-07-06 19:52:01.732592416 +0000 UTC m=+1926.105074149"
Jul 06 19:52:02.523833 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:02.523797    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:02.528728 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:02.528682    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:02.707038 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:02.707008    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:02.707990 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:02.707969    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:03.826509 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:03.826474    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:03.923491 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:03.923456    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:04.032526 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.032496    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"]
Jul 06 19:52:04.032906 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.032893    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy"
Jul 06 19:52:04.032993 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.032908    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f40f37b-ca3b-4d13-88d0-e408df7a9bbc" containerName="istio-proxy"
Jul 06 19:52:04.035828 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.035812    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.038787 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.038764    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-905adb-serving-cert\""
Jul 06 19:52:04.058105 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.058079    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"]
Jul 06 19:52:04.072742 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.072683    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:04.107008 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.106979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvj55\" (UniqueName: \"kubernetes.io/projected/a5ae4454-31e6-44c0-8e97-b87964ab42cf-kube-api-access-fvj55\") pod \"maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") " pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.107194 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.107028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ae4454-31e6-44c0-8e97-b87964ab42cf-maas-api-tls\") pod \"maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") " pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.107194 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.107102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae4454-31e6-44c0-8e97-b87964ab42cf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") " pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.207906 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.207870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvj55\" (UniqueName: \"kubernetes.io/projected/a5ae4454-31e6-44c0-8e97-b87964ab42cf-kube-api-access-fvj55\") pod \"maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") " pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.208091 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.207939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ae4454-31e6-44c0-8e97-b87964ab42cf-maas-api-tls\") pod \"maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") " pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.208091 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.208002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae4454-31e6-44c0-8e97-b87964ab42cf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") " pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.208091 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:52:04.208025    2579 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-905adb-serving-cert: secret "maas-api-e2e-inf-a-905adb-serving-cert" not found
Jul 06 19:52:04.208091 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:52:04.208088    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5ae4454-31e6-44c0-8e97-b87964ab42cf-maas-api-tls podName:a5ae4454-31e6-44c0-8e97-b87964ab42cf nodeName:}" failed. No retries permitted until 2026-07-06 19:52:04.708068882 +0000 UTC m=+1929.080550609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a5ae4454-31e6-44c0-8e97-b87964ab42cf-maas-api-tls") pod "maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp" (UID: "a5ae4454-31e6-44c0-8e97-b87964ab42cf") : secret "maas-api-e2e-inf-a-905adb-serving-cert" not found
Jul 06 19:52:04.208734 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.208679    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae4454-31e6-44c0-8e97-b87964ab42cf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") " pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.224029 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.223998    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvj55\" (UniqueName: \"kubernetes.io/projected/a5ae4454-31e6-44c0-8e97-b87964ab42cf-kube-api-access-fvj55\") pod \"maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") " pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.284273 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.284234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:04.574913 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.574818    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:04.672918 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.672877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:04.713659 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.713619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ae4454-31e6-44c0-8e97-b87964ab42cf-maas-api-tls\") pod \"maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") " pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.717083 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.717053    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ae4454-31e6-44c0-8e97-b87964ab42cf-maas-api-tls\") pod \"maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") " pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:04.946143 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:04.946105    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:05.084075 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:05.084047    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"]
Jul 06 19:52:05.085771 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:52:05.085744    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ae4454_31e6_44c0_8e97_b87964ab42cf.slice/crio-312cc83de23442db3a34a1b222013b0c088eb22b1059d683809f4eb3e1edcd34 WatchSource:0}: Error finding container 312cc83de23442db3a34a1b222013b0c088eb22b1059d683809f4eb3e1edcd34: Status 404 returned error can't find the container with id 312cc83de23442db3a34a1b222013b0c088eb22b1059d683809f4eb3e1edcd34
Jul 06 19:52:05.087276 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:05.087256    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 19:52:05.724486 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:05.724451    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp" event={"ID":"a5ae4454-31e6-44c0-8e97-b87964ab42cf","Type":"ContainerStarted","Data":"3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368"}
Jul 06 19:52:05.724655 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:05.724528    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp" event={"ID":"a5ae4454-31e6-44c0-8e97-b87964ab42cf","Type":"ContainerStarted","Data":"312cc83de23442db3a34a1b222013b0c088eb22b1059d683809f4eb3e1edcd34"}
Jul 06 19:52:05.724655 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:05.724606    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:05.749013 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:05.748966    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp" podStartSLOduration=1.308027934 podStartE2EDuration="1.748950871s" totalImagesPullingTime="440.922937ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:05.746967733 +0000 UTC m=+1930.119449466" watchObservedRunningTime="2026-07-06 19:52:05.748950871 +0000 UTC m=+1930.121432602"
Jul 06 19:52:08.353872 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:08.353839    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:08.819066 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:08.818977    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:09.172409 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:09.172368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:09.715773 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:09.715732    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:11.734846 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:11.734818    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:52:15.161347 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.161303    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:15.217084 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.217042    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"]
Jul 06 19:52:15.221416 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.221393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.224477 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.224457    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-40d2cc-serving-cert\""
Jul 06 19:52:15.243478 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.243450    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"]
Jul 06 19:52:15.261652 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.261571    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:15.328300 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.328264    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/689545b8-9c7d-4232-8bae-df22500eb067-openshift-service-ca\") pod \"maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") " pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.328494 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.328310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zpnb\" (UniqueName: \"kubernetes.io/projected/689545b8-9c7d-4232-8bae-df22500eb067-kube-api-access-2zpnb\") pod \"maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") " pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.328494 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.328335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/689545b8-9c7d-4232-8bae-df22500eb067-maas-api-tls\") pod \"maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") " pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.379928 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.379893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:15.430101 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.429993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/689545b8-9c7d-4232-8bae-df22500eb067-openshift-service-ca\") pod \"maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") " pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.430101 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.430056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zpnb\" (UniqueName: \"kubernetes.io/projected/689545b8-9c7d-4232-8bae-df22500eb067-kube-api-access-2zpnb\") pod \"maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") " pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.430101 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.430090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/689545b8-9c7d-4232-8bae-df22500eb067-maas-api-tls\") pod \"maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") " pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.430863 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.430798    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/689545b8-9c7d-4232-8bae-df22500eb067-openshift-service-ca\") pod \"maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") " pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.435812 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.435553    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/689545b8-9c7d-4232-8bae-df22500eb067-maas-api-tls\") pod \"maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") " pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.453271 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.453242    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zpnb\" (UniqueName: \"kubernetes.io/projected/689545b8-9c7d-4232-8bae-df22500eb067-kube-api-access-2zpnb\") pod \"maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") " pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.486536 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.486501    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:15.534967 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.534930    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:15.690015 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.689984    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"]
Jul 06 19:52:15.693082 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:52:15.693055    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689545b8_9c7d_4232_8bae_df22500eb067.slice/crio-e5d5655fbbad520287f769e426623131429a6dc2e00a2876dea0e98137e3da82 WatchSource:0}: Error finding container e5d5655fbbad520287f769e426623131429a6dc2e00a2876dea0e98137e3da82: Status 404 returned error can't find the container with id e5d5655fbbad520287f769e426623131429a6dc2e00a2876dea0e98137e3da82
Jul 06 19:52:15.778228 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.778193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m" event={"ID":"689545b8-9c7d-4232-8bae-df22500eb067","Type":"ContainerStarted","Data":"e5d5655fbbad520287f769e426623131429a6dc2e00a2876dea0e98137e3da82"}
Jul 06 19:52:15.796134 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.796101    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:15.896191 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:15.896152    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:16.784951 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:16.784912    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m" event={"ID":"689545b8-9c7d-4232-8bae-df22500eb067","Type":"ContainerStarted","Data":"03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092"}
Jul 06 19:52:16.785345 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:16.785010    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:16.807744 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:16.807682    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m" podStartSLOduration=1.522850883 podStartE2EDuration="1.807665571s" totalImagesPullingTime="284.814688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:52:16.805133739 +0000 UTC m=+1941.177615472" watchObservedRunningTime="2026-07-06 19:52:16.807665571 +0000 UTC m=+1941.180147349"
Jul 06 19:52:17.708297 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:17.708260    2579 patch_prober.go:28] interesting pod/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:52:17.708505 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:17.708314    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:52:17.791634 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:17.791603    2579 generic.go:356] "Generic (PLEG): container finished" podID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerID="a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a" exitCode=0
Jul 06 19:52:17.792096 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:17.791682    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" event={"ID":"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250","Type":"ContainerDied","Data":"a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a"}
Jul 06 19:52:17.792193 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:17.792178    2579 scope.go:117] "RemoveContainer" containerID="a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a"
Jul 06 19:52:17.793346 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:17.793315    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:52:17.793423 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:17.793400    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:52:17.793485 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:17.793470    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:52:18.798640 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:18.798607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" event={"ID":"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250","Type":"ContainerStarted","Data":"5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608"}
Jul 06 19:52:19.524690 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:19.524652    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:19.524991 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:19.524960    2579 patch_prober.go:28] interesting pod/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:52:19.525126 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:19.525025    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:52:19.728514 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:19.728467    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:20.524268 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:20.524232    2579 patch_prober.go:28] interesting pod/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:52:20.524785 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:20.524292    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:52:21.524247 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:21.524210    2579 patch_prober.go:28] interesting pod/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:52:21.524421 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:21.524268    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:52:22.523877 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:22.523843    2579 patch_prober.go:28] interesting pod/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 06 19:52:22.524060 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:22.523900    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 06 19:52:22.798184 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:22.798100    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:52:23.528480 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:23.528444    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:23.528753 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:23.528730    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:23.529357 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:23.529344    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:52:25.323496 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:25.323461    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:25.421595 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:25.421558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:26.193890 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:26.193857    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:26.325016 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:26.324976    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:37.077488 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:37.077453    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:37.352882 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:37.352852    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:52:50.062176 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:52:50.062088    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:12.619904 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:12.619860    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:14.263205 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:14.263167    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:16.331322 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:16.331281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:16.432131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:16.432101    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:16.579383 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:16.579346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:16.962095 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:16.962059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:17.486420 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:17.486380    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:17.592490 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:17.592442    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:20.788290 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:20.788258    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:35.943804 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:35.943767    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:47.617742 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:47.617685    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:47.964455 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:47.964356    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:48.065422 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:48.065387    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:50.332340 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:50.332303    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:50.433651 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:50.433614    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:53:53.003319 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:53:53.003281    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:29.516616 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:29.516534    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:30.559979 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:30.559940    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:36.471558 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:36.471525    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:36.576370 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:36.576330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:36.764814 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:36.764696    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:37.002764 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:37.002728    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:37.947914 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:37.947880    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:38.992146 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:38.992109    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:39.221279 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:39.221242    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:39.576467 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:39.576424    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:39.710845 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:39.710807    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:39.809531 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:39.809499    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:39.937178 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:39.937146    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"]
Jul 06 19:54:39.937494 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:39.937398    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp" podUID="a5ae4454-31e6-44c0-8e97-b87964ab42cf" containerName="maas-api" containerID="cri-o://3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368" gracePeriod=30
Jul 06 19:54:39.966906 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:39.966875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:54:40.192306 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.192242    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:54:40.266747 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.266714    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ae4454-31e6-44c0-8e97-b87964ab42cf-maas-api-tls\") pod \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") "
Jul 06 19:54:40.266911 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.266811    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvj55\" (UniqueName: \"kubernetes.io/projected/a5ae4454-31e6-44c0-8e97-b87964ab42cf-kube-api-access-fvj55\") pod \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") "
Jul 06 19:54:40.266911 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.266850    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae4454-31e6-44c0-8e97-b87964ab42cf-openshift-service-ca\") pod \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\" (UID: \"a5ae4454-31e6-44c0-8e97-b87964ab42cf\") "
Jul 06 19:54:40.267269 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.267233    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5ae4454-31e6-44c0-8e97-b87964ab42cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a5ae4454-31e6-44c0-8e97-b87964ab42cf" (UID: "a5ae4454-31e6-44c0-8e97-b87964ab42cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:54:40.268910 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.268884    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5ae4454-31e6-44c0-8e97-b87964ab42cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a5ae4454-31e6-44c0-8e97-b87964ab42cf" (UID: "a5ae4454-31e6-44c0-8e97-b87964ab42cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:54:40.269014 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.268921    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ae4454-31e6-44c0-8e97-b87964ab42cf-kube-api-access-fvj55" (OuterVolumeSpecName: "kube-api-access-fvj55") pod "a5ae4454-31e6-44c0-8e97-b87964ab42cf" (UID: "a5ae4454-31e6-44c0-8e97-b87964ab42cf"). InnerVolumeSpecName "kube-api-access-fvj55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:54:40.367746 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.367684    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvj55\" (UniqueName: \"kubernetes.io/projected/a5ae4454-31e6-44c0-8e97-b87964ab42cf-kube-api-access-fvj55\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:54:40.367746 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.367736    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae4454-31e6-44c0-8e97-b87964ab42cf-openshift-service-ca\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:54:40.367746 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.367752    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a5ae4454-31e6-44c0-8e97-b87964ab42cf-maas-api-tls\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:54:40.490113 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.490024    2579 generic.go:356] "Generic (PLEG): container finished" podID="a5ae4454-31e6-44c0-8e97-b87964ab42cf" containerID="3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368" exitCode=0
Jul 06 19:54:40.490113 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.490069    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"
Jul 06 19:54:40.490296 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.490111    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp" event={"ID":"a5ae4454-31e6-44c0-8e97-b87964ab42cf","Type":"ContainerDied","Data":"3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368"}
Jul 06 19:54:40.490296 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.490167    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp" event={"ID":"a5ae4454-31e6-44c0-8e97-b87964ab42cf","Type":"ContainerDied","Data":"312cc83de23442db3a34a1b222013b0c088eb22b1059d683809f4eb3e1edcd34"}
Jul 06 19:54:40.490296 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.490194    2579 scope.go:117] "RemoveContainer" containerID="3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368"
Jul 06 19:54:40.505908 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.505883    2579 scope.go:117] "RemoveContainer" containerID="3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368"
Jul 06 19:54:40.506271 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:54:40.506240    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368\": container with ID starting with 3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368 not found: ID does not exist" containerID="3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368"
Jul 06 19:54:40.506394 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.506282    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368"} err="failed to get container status \"3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368\": rpc error: code = NotFound desc = could not find container \"3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368\": container with ID starting with 3d392263a270e79dd13c65e5bf0a1f0ed1c36799c09611ae40ef7c46fa26b368 not found: ID does not exist"
Jul 06 19:54:40.519788 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.519758    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"]
Jul 06 19:54:40.523413 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:40.523392    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-905adb-766d796f7b-4h4jp"]
Jul 06 19:54:42.100297 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:42.100263    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5ae4454-31e6-44c0-8e97-b87964ab42cf" path="/var/lib/kubelet/pods/a5ae4454-31e6-44c0-8e97-b87964ab42cf/volumes"
Jul 06 19:54:44.632350 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:54:44.632307    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:21.533151 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:21.533113    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:21.789170 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:21.789078    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"]
Jul 06 19:55:21.789365 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:21.789311    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy" containerID="cri-o://5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608" gracePeriod=30
Jul 06 19:55:21.815858 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:21.815823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:22.053231 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:22.053138    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:22.434116 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:22.434075    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:22.848061 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:22.847967    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:22.971425 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:22.971386    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:23.076196 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.076163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:23.197131 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.197098    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"]
Jul 06 19:55:23.197330 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.197307    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m" podUID="689545b8-9c7d-4232-8bae-df22500eb067" containerName="maas-api" containerID="cri-o://03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092" gracePeriod=30
Jul 06 19:55:23.234438 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.234394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:23.450998 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.450942    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:55:23.467726 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.467687    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/689545b8-9c7d-4232-8bae-df22500eb067-maas-api-tls\") pod \"689545b8-9c7d-4232-8bae-df22500eb067\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") "
Jul 06 19:55:23.467856 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.467750    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/689545b8-9c7d-4232-8bae-df22500eb067-openshift-service-ca\") pod \"689545b8-9c7d-4232-8bae-df22500eb067\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") "
Jul 06 19:55:23.467856 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.467844    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zpnb\" (UniqueName: \"kubernetes.io/projected/689545b8-9c7d-4232-8bae-df22500eb067-kube-api-access-2zpnb\") pod \"689545b8-9c7d-4232-8bae-df22500eb067\" (UID: \"689545b8-9c7d-4232-8bae-df22500eb067\") "
Jul 06 19:55:23.468143 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.468115    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/689545b8-9c7d-4232-8bae-df22500eb067-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "689545b8-9c7d-4232-8bae-df22500eb067" (UID: "689545b8-9c7d-4232-8bae-df22500eb067"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:55:23.469657 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.469634    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/689545b8-9c7d-4232-8bae-df22500eb067-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "689545b8-9c7d-4232-8bae-df22500eb067" (UID: "689545b8-9c7d-4232-8bae-df22500eb067"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 19:55:23.469806 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.469776    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/689545b8-9c7d-4232-8bae-df22500eb067-kube-api-access-2zpnb" (OuterVolumeSpecName: "kube-api-access-2zpnb") pod "689545b8-9c7d-4232-8bae-df22500eb067" (UID: "689545b8-9c7d-4232-8bae-df22500eb067"). InnerVolumeSpecName "kube-api-access-2zpnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:23.531265 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.531230    2579 patch_prober.go:28] interesting pod/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 06 19:55:23.531431 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.531290    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 06 19:55:23.569318 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.569285    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zpnb\" (UniqueName: \"kubernetes.io/projected/689545b8-9c7d-4232-8bae-df22500eb067-kube-api-access-2zpnb\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:23.569318 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.569313    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/689545b8-9c7d-4232-8bae-df22500eb067-maas-api-tls\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:23.569318 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.569324    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/689545b8-9c7d-4232-8bae-df22500eb067-openshift-service-ca\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:23.696579 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.696543    2579 generic.go:356] "Generic (PLEG): container finished" podID="689545b8-9c7d-4232-8bae-df22500eb067" containerID="03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092" exitCode=0
Jul 06 19:55:23.696784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.696590    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"
Jul 06 19:55:23.696784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.696615    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m" event={"ID":"689545b8-9c7d-4232-8bae-df22500eb067","Type":"ContainerDied","Data":"03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092"}
Jul 06 19:55:23.696784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.696697    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m" event={"ID":"689545b8-9c7d-4232-8bae-df22500eb067","Type":"ContainerDied","Data":"e5d5655fbbad520287f769e426623131429a6dc2e00a2876dea0e98137e3da82"}
Jul 06 19:55:23.696784 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.696753    2579 scope.go:117] "RemoveContainer" containerID="03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092"
Jul 06 19:55:23.705605 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.705585    2579 scope.go:117] "RemoveContainer" containerID="03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092"
Jul 06 19:55:23.705869 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:55:23.705852    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092\": container with ID starting with 03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092 not found: ID does not exist" containerID="03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092"
Jul 06 19:55:23.705948 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.705875    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092"} err="failed to get container status \"03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092\": rpc error: code = NotFound desc = could not find container \"03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092\": container with ID starting with 03d56030e4951d3007a54f0f356933db6cc1f488bf4aa2179f2ff478bd265092 not found: ID does not exist"
Jul 06 19:55:23.719242 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.719215    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"]
Jul 06 19:55:23.724398 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:23.724377    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-40d2cc-5ddccdbc4b-vpc5m"]
Jul 06 19:55:24.099828 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:24.099802    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="689545b8-9c7d-4232-8bae-df22500eb067" path="/var/lib/kubelet/pods/689545b8-9c7d-4232-8bae-df22500eb067/volumes"
Jul 06 19:55:27.043900 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.043877    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:55:27.101970 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.101941    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-token\") pod \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") "
Jul 06 19:55:27.102146 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.101992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-socket\") pod \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") "
Jul 06 19:55:27.102146 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102026    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9w4j\" (UniqueName: \"kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-kube-api-access-b9w4j\") pod \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") "
Jul 06 19:55:27.102278 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102141    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-certs\") pod \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") "
Jul 06 19:55:27.102278 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102193    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-credential-socket\") pod \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") "
Jul 06 19:55:27.102278 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102220    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-podinfo\") pod \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") "
Jul 06 19:55:27.102278 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102249    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-data\") pod \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") "
Jul 06 19:55:27.102472 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102287    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istiod-ca-cert\") pod \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") "
Jul 06 19:55:27.102472 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102322    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-envoy\") pod \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\" (UID: \"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250\") "
Jul 06 19:55:27.102472 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102340    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" (UID: "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:27.102472 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102378    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" (UID: "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:27.102682 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102665    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:27.102791 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102762    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-workload-certs\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:27.103003 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102945    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" (UID: "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:27.103003 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.102986    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" (UID: "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:55:27.103200 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.103174    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-data" (OuterVolumeSpecName: "istio-data") pod "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" (UID: "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:27.104394 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.104367    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-kube-api-access-b9w4j" (OuterVolumeSpecName: "kube-api-access-b9w4j") pod "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" (UID: "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250"). InnerVolumeSpecName "kube-api-access-b9w4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:27.104526 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.104508    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" (UID: "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:55:27.104634 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.104615    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" (UID: "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:55:27.104685 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.104663    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-token" (OuterVolumeSpecName: "istio-token") pod "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" (UID: "a7d05857-d8b2-4b1f-bd9c-1c0d6b978250"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:55:27.204210 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.204175    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9w4j\" (UniqueName: \"kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-kube-api-access-b9w4j\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:27.204210 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.204205    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-credential-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:27.204210 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.204215    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-podinfo\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:27.204454 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.204224    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-data\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:27.204454 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.204232    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istiod-ca-cert\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:27.204454 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.204240    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-envoy\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:27.204454 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.204247    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250-istio-token\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:55:27.716961 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.716931    2579 generic.go:356] "Generic (PLEG): container finished" podID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerID="5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608" exitCode=0
Jul 06 19:55:27.717157 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.716982    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"
Jul 06 19:55:27.717157 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.717007    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" event={"ID":"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250","Type":"ContainerDied","Data":"5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608"}
Jul 06 19:55:27.717157 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.717051    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr" event={"ID":"a7d05857-d8b2-4b1f-bd9c-1c0d6b978250","Type":"ContainerDied","Data":"a0f6c4b080e0f41ac0418d1b163e0616800a8d4fdd53ad45bf05dbf20ecb473c"}
Jul 06 19:55:27.717157 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.717072    2579 scope.go:117] "RemoveContainer" containerID="5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608"
Jul 06 19:55:27.726278 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.726260    2579 scope.go:117] "RemoveContainer" containerID="a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a"
Jul 06 19:55:27.734408 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.734390    2579 scope.go:117] "RemoveContainer" containerID="5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608"
Jul 06 19:55:27.734656 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:55:27.734637    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608\": container with ID starting with 5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608 not found: ID does not exist" containerID="5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608"
Jul 06 19:55:27.734749 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.734670    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608"} err="failed to get container status \"5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608\": rpc error: code = NotFound desc = could not find container \"5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608\": container with ID starting with 5c94f3a23c8814f3ec18c566634551f1c40d46baa3551058acff370310e86608 not found: ID does not exist"
Jul 06 19:55:27.734749 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.734695    2579 scope.go:117] "RemoveContainer" containerID="a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a"
Jul 06 19:55:27.734969 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:55:27.734947    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a\": container with ID starting with a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a not found: ID does not exist" containerID="a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a"
Jul 06 19:55:27.735070 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.734975    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a"} err="failed to get container status \"a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a\": rpc error: code = NotFound desc = could not find container \"a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a\": container with ID starting with a5f237fdd274500d53762828ed9fb074e1452b570fd1e1cea7b88ff89ecb230a not found: ID does not exist"
Jul 06 19:55:27.741772 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.741749    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"]
Jul 06 19:55:27.751379 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:27.751346    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-905adb-openshift-default-544d5d644c-7qddr"]
Jul 06 19:55:28.099474 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:28.099434    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" path="/var/lib/kubelet/pods/a7d05857-d8b2-4b1f-bd9c-1c0d6b978250/volumes"
Jul 06 19:55:29.253100 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:29.253067    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:29.356366 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:29.356330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:29.547468 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:29.547372    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:29.777088 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:29.777052    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.157841 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.157809    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.480007 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.479915    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"]
Jul 06 19:55:30.480454 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480434    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy"
Jul 06 19:55:30.480540 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480459    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy"
Jul 06 19:55:30.480540 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480474    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy"
Jul 06 19:55:30.480540 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480482    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy"
Jul 06 19:55:30.480540 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480509    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="689545b8-9c7d-4232-8bae-df22500eb067" containerName="maas-api"
Jul 06 19:55:30.480540 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480518    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="689545b8-9c7d-4232-8bae-df22500eb067" containerName="maas-api"
Jul 06 19:55:30.480540 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480533    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ae4454-31e6-44c0-8e97-b87964ab42cf" containerName="maas-api"
Jul 06 19:55:30.480540 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480542    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ae4454-31e6-44c0-8e97-b87964ab42cf" containerName="maas-api"
Jul 06 19:55:30.480956 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480632    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy"
Jul 06 19:55:30.480956 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480644    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="689545b8-9c7d-4232-8bae-df22500eb067" containerName="maas-api"
Jul 06 19:55:30.480956 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.480653    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5ae4454-31e6-44c0-8e97-b87964ab42cf" containerName="maas-api"
Jul 06 19:55:30.483622 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.483600    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.486187 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.486164    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a5ae2d-openshift-default-dockercfg-55gnd\""
Jul 06 19:55:30.496185 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.496156    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"]
Jul 06 19:55:30.506530 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.506501    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.532961 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.532935    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-token\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.533094 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.532976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-podinfo\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.533094 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.533042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-credential-socket\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.533094 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.533081    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzvtn\" (UniqueName: \"kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-kube-api-access-qzvtn\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.533258 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.533148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-envoy\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.533258 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.533210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-data\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.533363 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.533262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-certs\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.533363 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.533305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-socket\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.533363 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.533340    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aafe01fb-41e7-4662-a77b-e2bb55428057-istiod-ca-cert\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.634355 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.634309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-token\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.634522 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.634463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-podinfo\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.634522 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.634509    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-credential-socket\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.634642 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.634529    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzvtn\" (UniqueName: \"kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-kube-api-access-qzvtn\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.634642 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.634555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-envoy\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.634642 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.634599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-data\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.634831 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.634652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-certs\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.634831 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.634697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-socket\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.634946 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.634825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aafe01fb-41e7-4662-a77b-e2bb55428057-istiod-ca-cert\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.635027 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.635005    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-credential-socket\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.635200 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.635157    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-certs\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.635314 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.635198    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-socket\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.635371 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.635310    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-data\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.635555 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.635536    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aafe01fb-41e7-4662-a77b-e2bb55428057-istiod-ca-cert\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.637457 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.637427    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-envoy\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.637656 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.637632    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-podinfo\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.643192 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.643170    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-token\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.643365 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.643340    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzvtn\" (UniqueName: \"kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-kube-api-access-qzvtn\") pod \"e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") " pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.752954 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.752859    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:30.794998 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.794969    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:30.939222 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.939189    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"]
Jul 06 19:55:30.942255 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:55:30.942229    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafe01fb_41e7_4662_a77b_e2bb55428057.slice/crio-09457669ae57a6d922d59edcef167223c077b7356dbd69adb0d898eb8bfd8b46 WatchSource:0}: Error finding container 09457669ae57a6d922d59edcef167223c077b7356dbd69adb0d898eb8bfd8b46: Status 404 returned error can't find the container with id 09457669ae57a6d922d59edcef167223c077b7356dbd69adb0d898eb8bfd8b46
Jul 06 19:55:30.944361 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.944328    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:55:30.944452 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.944393    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:55:30.944452 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:30.944423    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:55:31.737458 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:31.737420    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" event={"ID":"aafe01fb-41e7-4662-a77b-e2bb55428057","Type":"ContainerStarted","Data":"f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce"}
Jul 06 19:55:31.737978 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:31.737478    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" event={"ID":"aafe01fb-41e7-4662-a77b-e2bb55428057","Type":"ContainerStarted","Data":"09457669ae57a6d922d59edcef167223c077b7356dbd69adb0d898eb8bfd8b46"}
Jul 06 19:55:31.762954 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:31.762899    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" podStartSLOduration=1.762882533 podStartE2EDuration="1.762882533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:55:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:55:31.760695348 +0000 UTC m=+2136.133177132" watchObservedRunningTime="2026-07-06 19:55:31.762882533 +0000 UTC m=+2136.135364283"
Jul 06 19:55:31.795877 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:31.795845    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:31.801101 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:31.801079    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:32.742789 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:32.742759    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:32.743822 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:32.743806    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:33.809070 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:33.809026    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:33.948761 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:33.948719    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:34.112337 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:34.112297    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:34.649291 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:34.649256    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:34.751450 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:34.751418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:34.833815 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:34.833782    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:38.297874 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:38.297834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:38.784524 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:38.784479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:39.170962 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:39.170927    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:39.273431 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:39.273391    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:42.198245 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:42.198212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:42.291746 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:42.291683    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:42.375518 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:42.375481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:42.786528 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:42.786486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:42.967894 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:42.967845    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:46.717438 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:46.717405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:47.744416 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:47.744385    2579 patch_prober.go:28] interesting pod/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 06 19:55:47.744840 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:47.744438    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 06 19:55:47.820177 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:47.820144    2579 generic.go:356] "Generic (PLEG): container finished" podID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerID="f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce" exitCode=0
Jul 06 19:55:47.820374 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:47.820221    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" event={"ID":"aafe01fb-41e7-4662-a77b-e2bb55428057","Type":"ContainerDied","Data":"f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce"}
Jul 06 19:55:47.820669 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:47.820652    2579 scope.go:117] "RemoveContainer" containerID="f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce"
Jul 06 19:55:47.821714 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:47.821673    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:55:47.821806 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:47.821755    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:55:47.821806 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:47.821787    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:55:48.829748 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:48.829692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" event={"ID":"aafe01fb-41e7-4662-a77b-e2bb55428057","Type":"ContainerStarted","Data":"908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7"}
Jul 06 19:55:49.796009 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:49.795966    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:49.796294 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:49.796270    2579 patch_prober.go:28] interesting pod/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 06 19:55:49.796347 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:49.796323    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 06 19:55:50.795897 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:50.795858    2579 patch_prober.go:28] interesting pod/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 06 19:55:50.796287 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:50.795918    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 06 19:55:51.796095 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:51.796059    2579 patch_prober.go:28] interesting pod/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 06 19:55:51.796499 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:51.796119    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 06 19:55:52.799984 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:52.799951    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:52.800373 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:52.800233    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:52.800798 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:52.800780    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:55:55.472740 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:55.472687    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:55.774729 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:55.774623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:55.875278 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:55.875244    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:55.974804 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:55.974759    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:55:56.071666 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:55:56.071565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:02.211926 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:02.211884    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:02.315454 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:02.315419    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:02.477431 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:02.477351    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"]
Jul 06 19:56:02.477584 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:02.477541    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy" containerID="cri-o://908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7" gracePeriod=30
Jul 06 19:56:02.514673 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:02.514640    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:02.764817 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:02.764725    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:02.949992 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:02.949961    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:03.381594 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:03.381558    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:03.468246 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:03.468210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:03.544963 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:03.544923    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:03.688148 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:03.688034    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:07.734880 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.734856    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:56:07.780669 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.780592    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzvtn\" (UniqueName: \"kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-kube-api-access-qzvtn\") pod \"aafe01fb-41e7-4662-a77b-e2bb55428057\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") "
Jul 06 19:56:07.780669 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.780652    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-certs\") pod \"aafe01fb-41e7-4662-a77b-e2bb55428057\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") "
Jul 06 19:56:07.780909 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.780672    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-podinfo\") pod \"aafe01fb-41e7-4662-a77b-e2bb55428057\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") "
Jul 06 19:56:07.780909 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.780807    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-socket\") pod \"aafe01fb-41e7-4662-a77b-e2bb55428057\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") "
Jul 06 19:56:07.780909 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.780848    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aafe01fb-41e7-4662-a77b-e2bb55428057-istiod-ca-cert\") pod \"aafe01fb-41e7-4662-a77b-e2bb55428057\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") "
Jul 06 19:56:07.780909 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.780893    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-data\") pod \"aafe01fb-41e7-4662-a77b-e2bb55428057\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") "
Jul 06 19:56:07.781126 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.780949    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-credential-socket\") pod \"aafe01fb-41e7-4662-a77b-e2bb55428057\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") "
Jul 06 19:56:07.781126 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.780971    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aafe01fb-41e7-4662-a77b-e2bb55428057" (UID: "aafe01fb-41e7-4662-a77b-e2bb55428057"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:56:07.781126 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.780990    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-envoy\") pod \"aafe01fb-41e7-4662-a77b-e2bb55428057\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") "
Jul 06 19:56:07.781126 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.781029    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-token\") pod \"aafe01fb-41e7-4662-a77b-e2bb55428057\" (UID: \"aafe01fb-41e7-4662-a77b-e2bb55428057\") "
Jul 06 19:56:07.781678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.781409    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-certs\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:56:07.781678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.781441    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aafe01fb-41e7-4662-a77b-e2bb55428057-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aafe01fb-41e7-4662-a77b-e2bb55428057" (UID: "aafe01fb-41e7-4662-a77b-e2bb55428057"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 19:56:07.781678 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.781451    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aafe01fb-41e7-4662-a77b-e2bb55428057" (UID: "aafe01fb-41e7-4662-a77b-e2bb55428057"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:56:07.781926 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.781870    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-data" (OuterVolumeSpecName: "istio-data") pod "aafe01fb-41e7-4662-a77b-e2bb55428057" (UID: "aafe01fb-41e7-4662-a77b-e2bb55428057"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:56:07.781985 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.781949    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aafe01fb-41e7-4662-a77b-e2bb55428057" (UID: "aafe01fb-41e7-4662-a77b-e2bb55428057"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:56:07.783071 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.783047    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aafe01fb-41e7-4662-a77b-e2bb55428057" (UID: "aafe01fb-41e7-4662-a77b-e2bb55428057"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 19:56:07.783330 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.783302    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aafe01fb-41e7-4662-a77b-e2bb55428057" (UID: "aafe01fb-41e7-4662-a77b-e2bb55428057"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 19:56:07.783449 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.783403    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-kube-api-access-qzvtn" (OuterVolumeSpecName: "kube-api-access-qzvtn") pod "aafe01fb-41e7-4662-a77b-e2bb55428057" (UID: "aafe01fb-41e7-4662-a77b-e2bb55428057"). InnerVolumeSpecName "kube-api-access-qzvtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:56:07.783525 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.783455    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-token" (OuterVolumeSpecName: "istio-token") pod "aafe01fb-41e7-4662-a77b-e2bb55428057" (UID: "aafe01fb-41e7-4662-a77b-e2bb55428057"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 19:56:07.881996 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.881961    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-podinfo\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:56:07.881996 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.881989    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-workload-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:56:07.881996 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.881998    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aafe01fb-41e7-4662-a77b-e2bb55428057-istiod-ca-cert\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:56:07.881996 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.882007    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-data\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:56:07.882253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.882015    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-credential-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:56:07.882253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.882023    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-envoy\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:56:07.882253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.882031    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-istio-token\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:56:07.882253 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.882039    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzvtn\" (UniqueName: \"kubernetes.io/projected/aafe01fb-41e7-4662-a77b-e2bb55428057-kube-api-access-qzvtn\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 19:56:07.923654 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.923619    2579 generic.go:356] "Generic (PLEG): container finished" podID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerID="908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7" exitCode=0
Jul 06 19:56:07.923864 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.923672    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"
Jul 06 19:56:07.923864 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.923730    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" event={"ID":"aafe01fb-41e7-4662-a77b-e2bb55428057","Type":"ContainerDied","Data":"908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7"}
Jul 06 19:56:07.923864 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.923798    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl" event={"ID":"aafe01fb-41e7-4662-a77b-e2bb55428057","Type":"ContainerDied","Data":"09457669ae57a6d922d59edcef167223c077b7356dbd69adb0d898eb8bfd8b46"}
Jul 06 19:56:07.923864 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.923828    2579 scope.go:117] "RemoveContainer" containerID="908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7"
Jul 06 19:56:07.932905 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.932888    2579 scope.go:117] "RemoveContainer" containerID="f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce"
Jul 06 19:56:07.940561 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.940545    2579 scope.go:117] "RemoveContainer" containerID="908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7"
Jul 06 19:56:07.940836 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:56:07.940815    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7\": container with ID starting with 908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7 not found: ID does not exist" containerID="908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7"
Jul 06 19:56:07.940895 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.940843    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7"} err="failed to get container status \"908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7\": rpc error: code = NotFound desc = could not find container \"908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7\": container with ID starting with 908a03773da794a86bec972f210cc1c7a386a515cb096135d7e503da697c19e7 not found: ID does not exist"
Jul 06 19:56:07.940895 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.940860    2579 scope.go:117] "RemoveContainer" containerID="f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce"
Jul 06 19:56:07.941107 ip-10-0-135-109 kubenswrapper[2579]: E0706 19:56:07.941091    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce\": container with ID starting with f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce not found: ID does not exist" containerID="f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce"
Jul 06 19:56:07.941154 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.941112    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce"} err="failed to get container status \"f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce\": rpc error: code = NotFound desc = could not find container \"f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce\": container with ID starting with f68a698dfbbe66898238d1edba8217778a3a67911aaf051fb4d47636f89f26ce not found: ID does not exist"
Jul 06 19:56:07.948327 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.948306    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"]
Jul 06 19:56:07.952893 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:07.952869    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a5ae2d-openshift-default-5966949cbc-tr2nl"]
Jul 06 19:56:08.099000 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:08.098975    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" path="/var/lib/kubelet/pods/aafe01fb-41e7-4662-a77b-e2bb55428057/volumes"
Jul 06 19:56:09.543776 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:09.543737    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:09.641203 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:09.641176    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:09.872041 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:09.872008    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:10.117659 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.117625    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:10.477448 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.477412    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:10.795122 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.795043    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"]
Jul 06 19:56:10.795492 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.795414    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy"
Jul 06 19:56:10.795492 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.795425    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy"
Jul 06 19:56:10.795492 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.795435    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy"
Jul 06 19:56:10.795492 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.795440    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy"
Jul 06 19:56:10.795656 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.795513    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy"
Jul 06 19:56:10.795656 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.795526    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7d05857-d8b2-4b1f-bd9c-1c0d6b978250" containerName="istio-proxy"
Jul 06 19:56:10.799936 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.799917    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.802551 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.802532    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9cb33a-openshift-default-dockercfg-6l8df\""
Jul 06 19:56:10.811806 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.811781    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-socket\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.811913 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.811812    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-certs\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.811913 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.811828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-envoy\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.811913 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.811849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istiod-ca-cert\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.812020 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.811958    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-data\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.812020 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.812010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-podinfo\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.812089 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.812040    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-credential-socket\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.812089 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.812062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-token\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.812153 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.812129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9djq\" (UniqueName: \"kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-kube-api-access-t9djq\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.815513 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.815490    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"]
Jul 06 19:56:10.830188 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.830156    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:10.913145 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913113    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-data\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.913328 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-podinfo\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.913328 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-credential-socket\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.913328 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913212    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-token\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.913328 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913257    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9djq\" (UniqueName: \"kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-kube-api-access-t9djq\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.913328 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-socket\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.913619 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-certs\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.913619 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-envoy\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.913619 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istiod-ca-cert\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.913802 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913624    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-data\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.913802 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.913661    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-credential-socket\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.914086 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.914061    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-socket\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.914208 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.914161    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-certs\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.914364 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.914340    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istiod-ca-cert\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.915944 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.915921    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-envoy\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.916013 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.915973    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-podinfo\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.925032 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.925012    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-token\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:10.927417 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:10.927391    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9djq\" (UniqueName: \"kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-kube-api-access-t9djq\") pod \"e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") " pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:11.097119 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:11.097037    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:11.110028 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:11.110007    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:11.255927 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:11.255901    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"]
Jul 06 19:56:11.258492 ip-10-0-135-109 kubenswrapper[2579]: W0706 19:56:11.258464    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a58535b_8575_4b8c_90d2_ea08db7cdcc6.slice/crio-c0d01e469ea82fee06d35eccfa8c0d37586c58845cbed8fb32cde5cb5d777638 WatchSource:0}: Error finding container c0d01e469ea82fee06d35eccfa8c0d37586c58845cbed8fb32cde5cb5d777638: Status 404 returned error can't find the container with id c0d01e469ea82fee06d35eccfa8c0d37586c58845cbed8fb32cde5cb5d777638
Jul 06 19:56:11.260635 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:11.260600    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:56:11.260694 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:11.260663    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:56:11.260694 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:11.260688    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:56:11.945891 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:11.945850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" event={"ID":"8a58535b-8575-4b8c-90d2-ea08db7cdcc6","Type":"ContainerStarted","Data":"27e592f7e9ebef7981f8628b912bfc88a099dc40511787f724f331bdc815ac05"}
Jul 06 19:56:11.946298 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:11.945913    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" event={"ID":"8a58535b-8575-4b8c-90d2-ea08db7cdcc6","Type":"ContainerStarted","Data":"c0d01e469ea82fee06d35eccfa8c0d37586c58845cbed8fb32cde5cb5d777638"}
Jul 06 19:56:11.969003 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:11.968950    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" podStartSLOduration=1.968933658 podStartE2EDuration="1.968933658s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:56:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:56:11.966860349 +0000 UTC m=+2176.339342080" watchObservedRunningTime="2026-07-06 19:56:11.968933658 +0000 UTC m=+2176.341415389"
Jul 06 19:56:12.110821 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:12.110793    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:12.115774 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:12.115749    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:12.950760 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:12.950730    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:12.951731 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:12.951696    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:13.918609 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:13.918518    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:14.022940 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:14.022901    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:14.124717 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:14.124680    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:14.367649 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:14.367609    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:14.527155 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:14.527122    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:14.644250 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:14.644161    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:18.510218 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:18.510183    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:18.879856 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:18.879824    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:19.205427 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:19.205341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:19.376245 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:19.376211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:22.440670 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:22.440628    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:22.534547 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:22.534508    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:22.643542 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:22.643510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:22.941525 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:22.941491    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.324218 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:23.324126    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:23.417506 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:23.417473    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:26.971207 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:26.971169    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:27.952136 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:27.952102    2579 patch_prober.go:28] interesting pod/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 19:56:27.952346 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:27.952168    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 19:56:28.023230 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:28.023197    2579 generic.go:356] "Generic (PLEG): container finished" podID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerID="27e592f7e9ebef7981f8628b912bfc88a099dc40511787f724f331bdc815ac05" exitCode=0
Jul 06 19:56:28.023598 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:28.023267    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" event={"ID":"8a58535b-8575-4b8c-90d2-ea08db7cdcc6","Type":"ContainerDied","Data":"27e592f7e9ebef7981f8628b912bfc88a099dc40511787f724f331bdc815ac05"}
Jul 06 19:56:28.023776 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:28.023761    2579 scope.go:117] "RemoveContainer" containerID="27e592f7e9ebef7981f8628b912bfc88a099dc40511787f724f331bdc815ac05"
Jul 06 19:56:28.024764 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:28.024741    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:56:28.024815 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:28.024806    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:56:28.024851 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:28.024841    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 06 19:56:29.029333 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:29.029298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" event={"ID":"8a58535b-8575-4b8c-90d2-ea08db7cdcc6","Type":"ContainerStarted","Data":"f7582973868021e7cfefe8cd7d67c8f5fe5c0c785892d8b6a6c0e364edf02a2f"}
Jul 06 19:56:29.110388 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:29.110356    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:29.110564 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:29.110527    2579 patch_prober.go:28] interesting pod/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 19:56:29.110640 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:29.110581    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 19:56:30.111061 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:30.111023    2579 patch_prober.go:28] interesting pod/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 19:56:30.111452 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:30.111077    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 19:56:31.111069 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:31.111034    2579 patch_prober.go:28] interesting pod/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 19:56:31.111462 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:31.111087    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 19:56:32.110980 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:32.110946    2579 patch_prober.go:28] interesting pod/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 06 19:56:32.111127 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:32.110993    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 06 19:56:33.114644 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:33.114615    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:33.115195 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:33.114924    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:33.115618 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:33.115595    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 19:56:36.425945 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:36.425907    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:36.591491 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:36.591453    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:41.656631 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:41.656598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:45.097833 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:45.097795    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:45.191866 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:45.191829    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:56:55.543126 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:56:55.543092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:02.557459 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:57:02.557421    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:40.686247 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:57:40.686159    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:40.812202 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:57:40.812162    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:57:56.653280 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:57:56.653234    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:05.275334 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:58:05.275301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:51.202566 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:58:51.202481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:52.471928 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:58:52.471888    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:57.040813 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:58:57.040778    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:58:57.786592 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:58:57.786549    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:09.254818 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:59:09.254778    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 19:59:44.165210 ip-10-0-135-109 kubenswrapper[2579]: I0706 19:59:44.165176    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:00.142328 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.142292    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-fgprb"]
Jul 06 20:00:00.143004 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.142985    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aafe01fb-41e7-4662-a77b-e2bb55428057" containerName="istio-proxy"
Jul 06 20:00:00.148065 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.148028    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"]
Jul 06 20:00:00.150519 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.150478    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-fgprb"
Jul 06 20:00:00.152477 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.152455    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"]
Jul 06 20:00:00.152605 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.152583    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"
Jul 06 20:00:00.155764 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.155738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"
Jul 06 20:00:00.159073 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.159052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-fgprb"]
Jul 06 20:00:00.161896 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.161874    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"]
Jul 06 20:00:00.170916 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.170618    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"]
Jul 06 20:00:00.321975 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.321931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjn8c\" (UniqueName: \"kubernetes.io/projected/20eb212d-4d29-4d49-ae7e-76b1994d4510-kube-api-access-kjn8c\") pod \"maas-api-key-cleanup-29722800-fgprb\" (UID: \"20eb212d-4d29-4d49-ae7e-76b1994d4510\") " pod="opendatahub/maas-api-key-cleanup-29722800-fgprb"
Jul 06 20:00:00.322157 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.321983    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spr5g\" (UniqueName: \"kubernetes.io/projected/19b0e8bc-4033-415a-a5ee-64ff40a0acf9-kube-api-access-spr5g\") pod \"maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz\" (UID: \"19b0e8bc-4033-415a-a5ee-64ff40a0acf9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"
Jul 06 20:00:00.322157 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.322003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nglkp\" (UniqueName: \"kubernetes.io/projected/284ac164-0fce-4b21-818d-760c79fc3a51-kube-api-access-nglkp\") pod \"maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z\" (UID: \"284ac164-0fce-4b21-818d-760c79fc3a51\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"
Jul 06 20:00:00.422941 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.422831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjn8c\" (UniqueName: \"kubernetes.io/projected/20eb212d-4d29-4d49-ae7e-76b1994d4510-kube-api-access-kjn8c\") pod \"maas-api-key-cleanup-29722800-fgprb\" (UID: \"20eb212d-4d29-4d49-ae7e-76b1994d4510\") " pod="opendatahub/maas-api-key-cleanup-29722800-fgprb"
Jul 06 20:00:00.422941 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.422887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spr5g\" (UniqueName: \"kubernetes.io/projected/19b0e8bc-4033-415a-a5ee-64ff40a0acf9-kube-api-access-spr5g\") pod \"maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz\" (UID: \"19b0e8bc-4033-415a-a5ee-64ff40a0acf9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"
Jul 06 20:00:00.423189 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.423001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nglkp\" (UniqueName: \"kubernetes.io/projected/284ac164-0fce-4b21-818d-760c79fc3a51-kube-api-access-nglkp\") pod \"maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z\" (UID: \"284ac164-0fce-4b21-818d-760c79fc3a51\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"
Jul 06 20:00:00.431960 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.431916    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nglkp\" (UniqueName: \"kubernetes.io/projected/284ac164-0fce-4b21-818d-760c79fc3a51-kube-api-access-nglkp\") pod \"maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z\" (UID: \"284ac164-0fce-4b21-818d-760c79fc3a51\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"
Jul 06 20:00:00.431960 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.431940    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spr5g\" (UniqueName: \"kubernetes.io/projected/19b0e8bc-4033-415a-a5ee-64ff40a0acf9-kube-api-access-spr5g\") pod \"maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz\" (UID: \"19b0e8bc-4033-415a-a5ee-64ff40a0acf9\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"
Jul 06 20:00:00.432247 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.432223    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjn8c\" (UniqueName: \"kubernetes.io/projected/20eb212d-4d29-4d49-ae7e-76b1994d4510-kube-api-access-kjn8c\") pod \"maas-api-key-cleanup-29722800-fgprb\" (UID: \"20eb212d-4d29-4d49-ae7e-76b1994d4510\") " pod="opendatahub/maas-api-key-cleanup-29722800-fgprb"
Jul 06 20:00:00.465159 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.465130    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-fgprb"
Jul 06 20:00:00.475402 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.475373    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"
Jul 06 20:00:00.481399 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.481340    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"
Jul 06 20:00:00.628104 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.628018    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29722800-fgprb"]
Jul 06 20:00:00.629666 ip-10-0-135-109 kubenswrapper[2579]: W0706 20:00:00.629634    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20eb212d_4d29_4d49_ae7e_76b1994d4510.slice/crio-ee7df9c6db3057f1f71dc5dde72b51c728fe637c782b2ee210808ee4db87aadb WatchSource:0}: Error finding container ee7df9c6db3057f1f71dc5dde72b51c728fe637c782b2ee210808ee4db87aadb: Status 404 returned error can't find the container with id ee7df9c6db3057f1f71dc5dde72b51c728fe637c782b2ee210808ee4db87aadb
Jul 06 20:00:00.862729 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.862681    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"]
Jul 06 20:00:00.866093 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:00.866071    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"]
Jul 06 20:00:00.868069 ip-10-0-135-109 kubenswrapper[2579]: W0706 20:00:00.868043    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284ac164_0fce_4b21_818d_760c79fc3a51.slice/crio-265511a5ab4f35421a2909af361ef5b0668b0760a1b114d04222b8c110d7c46d WatchSource:0}: Error finding container 265511a5ab4f35421a2909af361ef5b0668b0760a1b114d04222b8c110d7c46d: Status 404 returned error can't find the container with id 265511a5ab4f35421a2909af361ef5b0668b0760a1b114d04222b8c110d7c46d
Jul 06 20:00:00.868290 ip-10-0-135-109 kubenswrapper[2579]: W0706 20:00:00.868274    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b0e8bc_4033_415a_a5ee_64ff40a0acf9.slice/crio-681d7b6fe988ee97afa0182920f4f085c88c77ed17af6cf071d4fdf35934ae2f WatchSource:0}: Error finding container 681d7b6fe988ee97afa0182920f4f085c88c77ed17af6cf071d4fdf35934ae2f: Status 404 returned error can't find the container with id 681d7b6fe988ee97afa0182920f4f085c88c77ed17af6cf071d4fdf35934ae2f
Jul 06 20:00:01.030320 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:01.030278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz" event={"ID":"19b0e8bc-4033-415a-a5ee-64ff40a0acf9","Type":"ContainerStarted","Data":"681d7b6fe988ee97afa0182920f4f085c88c77ed17af6cf071d4fdf35934ae2f"}
Jul 06 20:00:01.031871 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:01.031846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-fgprb" event={"ID":"20eb212d-4d29-4d49-ae7e-76b1994d4510","Type":"ContainerStarted","Data":"dd1152260d08665d2a2499a4ae259f4281e98626dc8f9ea9ba60992c92f50079"}
Jul 06 20:00:01.032019 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:01.031898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-fgprb" event={"ID":"20eb212d-4d29-4d49-ae7e-76b1994d4510","Type":"ContainerStarted","Data":"ee7df9c6db3057f1f71dc5dde72b51c728fe637c782b2ee210808ee4db87aadb"}
Jul 06 20:00:01.033060 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:01.033037    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z" event={"ID":"284ac164-0fce-4b21-818d-760c79fc3a51","Type":"ContainerStarted","Data":"265511a5ab4f35421a2909af361ef5b0668b0760a1b114d04222b8c110d7c46d"}
Jul 06 20:00:01.062064 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:01.062002    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29722800-fgprb" podStartSLOduration=1.061981413 podStartE2EDuration="1.061981413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:00:01.060728823 +0000 UTC m=+2405.433210555" watchObservedRunningTime="2026-07-06 20:00:01.061981413 +0000 UTC m=+2405.434463146"
Jul 06 20:00:02.041115 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:02.041021    2579 generic.go:356] "Generic (PLEG): container finished" podID="19b0e8bc-4033-415a-a5ee-64ff40a0acf9" containerID="6093af90b82512566640e4a4ee3c842d43e8387d4d152b1aa6bb29c140662eb6" exitCode=0
Jul 06 20:00:02.041115 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:02.041101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz" event={"ID":"19b0e8bc-4033-415a-a5ee-64ff40a0acf9","Type":"ContainerDied","Data":"6093af90b82512566640e4a4ee3c842d43e8387d4d152b1aa6bb29c140662eb6"}
Jul 06 20:00:02.042505 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:02.042476    2579 generic.go:356] "Generic (PLEG): container finished" podID="20eb212d-4d29-4d49-ae7e-76b1994d4510" containerID="dd1152260d08665d2a2499a4ae259f4281e98626dc8f9ea9ba60992c92f50079" exitCode=0
Jul 06 20:00:02.042628 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:02.042559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-fgprb" event={"ID":"20eb212d-4d29-4d49-ae7e-76b1994d4510","Type":"ContainerDied","Data":"dd1152260d08665d2a2499a4ae259f4281e98626dc8f9ea9ba60992c92f50079"}
Jul 06 20:00:02.043948 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:02.043927    2579 generic.go:356] "Generic (PLEG): container finished" podID="284ac164-0fce-4b21-818d-760c79fc3a51" containerID="58b46ac88de720ec49b72ca2fa65c8fc195122833f6a23cdf7b111c6779c4aac" exitCode=0
Jul 06 20:00:02.044014 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:02.043960    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z" event={"ID":"284ac164-0fce-4b21-818d-760c79fc3a51","Type":"ContainerDied","Data":"58b46ac88de720ec49b72ca2fa65c8fc195122833f6a23cdf7b111c6779c4aac"}
Jul 06 20:00:03.193355 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.193325    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"
Jul 06 20:00:03.233621 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.233583    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"
Jul 06 20:00:03.236787 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.236765    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-fgprb"
Jul 06 20:00:03.249955 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.249923    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjn8c\" (UniqueName: \"kubernetes.io/projected/20eb212d-4d29-4d49-ae7e-76b1994d4510-kube-api-access-kjn8c\") pod \"20eb212d-4d29-4d49-ae7e-76b1994d4510\" (UID: \"20eb212d-4d29-4d49-ae7e-76b1994d4510\") "
Jul 06 20:00:03.250097 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.249998    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nglkp\" (UniqueName: \"kubernetes.io/projected/284ac164-0fce-4b21-818d-760c79fc3a51-kube-api-access-nglkp\") pod \"284ac164-0fce-4b21-818d-760c79fc3a51\" (UID: \"284ac164-0fce-4b21-818d-760c79fc3a51\") "
Jul 06 20:00:03.250097 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.250088    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spr5g\" (UniqueName: \"kubernetes.io/projected/19b0e8bc-4033-415a-a5ee-64ff40a0acf9-kube-api-access-spr5g\") pod \"19b0e8bc-4033-415a-a5ee-64ff40a0acf9\" (UID: \"19b0e8bc-4033-415a-a5ee-64ff40a0acf9\") "
Jul 06 20:00:03.252394 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.252367    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b0e8bc-4033-415a-a5ee-64ff40a0acf9-kube-api-access-spr5g" (OuterVolumeSpecName: "kube-api-access-spr5g") pod "19b0e8bc-4033-415a-a5ee-64ff40a0acf9" (UID: "19b0e8bc-4033-415a-a5ee-64ff40a0acf9"). InnerVolumeSpecName "kube-api-access-spr5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:00:03.252530 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.252458    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/284ac164-0fce-4b21-818d-760c79fc3a51-kube-api-access-nglkp" (OuterVolumeSpecName: "kube-api-access-nglkp") pod "284ac164-0fce-4b21-818d-760c79fc3a51" (UID: "284ac164-0fce-4b21-818d-760c79fc3a51"). InnerVolumeSpecName "kube-api-access-nglkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:00:03.253046 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.253001    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20eb212d-4d29-4d49-ae7e-76b1994d4510-kube-api-access-kjn8c" (OuterVolumeSpecName: "kube-api-access-kjn8c") pod "20eb212d-4d29-4d49-ae7e-76b1994d4510" (UID: "20eb212d-4d29-4d49-ae7e-76b1994d4510"). InnerVolumeSpecName "kube-api-access-kjn8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:00:03.351542 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.351504    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nglkp\" (UniqueName: \"kubernetes.io/projected/284ac164-0fce-4b21-818d-760c79fc3a51-kube-api-access-nglkp\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:00:03.351542 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.351536    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spr5g\" (UniqueName: \"kubernetes.io/projected/19b0e8bc-4033-415a-a5ee-64ff40a0acf9-kube-api-access-spr5g\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:00:03.351779 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:03.351549    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjn8c\" (UniqueName: \"kubernetes.io/projected/20eb212d-4d29-4d49-ae7e-76b1994d4510-kube-api-access-kjn8c\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:00:04.053650 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:04.053621    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29722800-fgprb"
Jul 06 20:00:04.053825 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:04.053656    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29722800-fgprb" event={"ID":"20eb212d-4d29-4d49-ae7e-76b1994d4510","Type":"ContainerDied","Data":"ee7df9c6db3057f1f71dc5dde72b51c728fe637c782b2ee210808ee4db87aadb"}
Jul 06 20:00:04.053825 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:04.053748    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee7df9c6db3057f1f71dc5dde72b51c728fe637c782b2ee210808ee4db87aadb"
Jul 06 20:00:04.054924 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:04.054896    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"
Jul 06 20:00:04.055045 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:04.054940    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z" event={"ID":"284ac164-0fce-4b21-818d-760c79fc3a51","Type":"ContainerDied","Data":"265511a5ab4f35421a2909af361ef5b0668b0760a1b114d04222b8c110d7c46d"}
Jul 06 20:00:04.055045 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:04.054981    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="265511a5ab4f35421a2909af361ef5b0668b0760a1b114d04222b8c110d7c46d"
Jul 06 20:00:04.056248 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:04.056223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz" event={"ID":"19b0e8bc-4033-415a-a5ee-64ff40a0acf9","Type":"ContainerDied","Data":"681d7b6fe988ee97afa0182920f4f085c88c77ed17af6cf071d4fdf35934ae2f"}
Jul 06 20:00:04.056379 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:04.056250    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"
Jul 06 20:00:04.056379 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:04.056265    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="681d7b6fe988ee97afa0182920f4f085c88c77ed17af6cf071d4fdf35934ae2f"
Jul 06 20:00:20.062983 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:20.062891    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:20.155283 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:20.155246    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:28.126437 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:28.126400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:28.893088 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:28.893053    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:00:55.266131 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:00:55.266093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:23.095810 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:01:23.095772    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:37.191017 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:01:37.190978    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:37.293016 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:01:37.292978    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:45.860663 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:01:45.860630    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:01:45.959248 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:01:45.959206    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:05.360295 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:05.360203    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:06.255424 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:06.255381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:11.804906 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:11.804868    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:12.186538 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:12.186506    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:12.286615 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:12.286581    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:12.387524 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:12.387488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:12.465348 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:12.465264    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:12.470021 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:12.469991    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"]
Jul 06 20:02:12.473751 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:12.473726    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-9cb33a-29722800-96w9z"]
Jul 06 20:02:14.099359 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:14.099325    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="284ac164-0fce-4b21-818d-760c79fc3a51" path="/var/lib/kubelet/pods/284ac164-0fce-4b21-818d-760c79fc3a51/volumes"
Jul 06 20:02:17.298315 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:17.298279    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:23.337141 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:23.337105    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:23.584251 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:23.584213    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"]
Jul 06 20:02:23.584514 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:23.584488    2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerName="istio-proxy" containerID="cri-o://f7582973868021e7cfefe8cd7d67c8f5fe5c0c785892d8b6a6c0e364edf02a2f" gracePeriod=30
Jul 06 20:02:23.609736 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:23.609689    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:23.905943 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:23.905841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:24.068340 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:24.068303    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:24.428023 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:24.427980    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:24.525770 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:24.525730    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:24.628670 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:24.628637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:24.758111 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:24.758015    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"]
Jul 06 20:02:24.762868 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:24.762834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:24.764254 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:24.764234    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-97cecc-29722800-zg7mz"]
Jul 06 20:02:26.099828 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:26.099798    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b0e8bc-4033-415a-a5ee-64ff40a0acf9" path="/var/lib/kubelet/pods/19b0e8bc-4033-415a-a5ee-64ff40a0acf9/volumes"
Jul 06 20:02:28.747417 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.747383    2579 generic.go:356] "Generic (PLEG): container finished" podID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerID="f7582973868021e7cfefe8cd7d67c8f5fe5c0c785892d8b6a6c0e364edf02a2f" exitCode=0
Jul 06 20:02:28.747889 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.747450    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" event={"ID":"8a58535b-8575-4b8c-90d2-ea08db7cdcc6","Type":"ContainerDied","Data":"f7582973868021e7cfefe8cd7d67c8f5fe5c0c785892d8b6a6c0e364edf02a2f"}
Jul 06 20:02:28.747889 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.747514    2579 scope.go:117] "RemoveContainer" containerID="27e592f7e9ebef7981f8628b912bfc88a099dc40511787f724f331bdc815ac05"
Jul 06 20:02:28.836487 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.836463    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 20:02:28.894092 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9djq\" (UniqueName: \"kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-kube-api-access-t9djq\") pod \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") "
Jul 06 20:02:28.894280 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894100    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istiod-ca-cert\") pod \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") "
Jul 06 20:02:28.894280 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894124    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-certs\") pod \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") "
Jul 06 20:02:28.894280 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894145    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-podinfo\") pod \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") "
Jul 06 20:02:28.894280 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894215    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-envoy\") pod \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") "
Jul 06 20:02:28.894280 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894242    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-data\") pod \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") "
Jul 06 20:02:28.894551 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894385    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-socket\") pod \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") "
Jul 06 20:02:28.894551 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894428    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a58535b-8575-4b8c-90d2-ea08db7cdcc6" (UID: "8a58535b-8575-4b8c-90d2-ea08db7cdcc6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:28.894551 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894457    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-credential-socket\") pod \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") "
Jul 06 20:02:28.894551 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894486    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-token\") pod \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\" (UID: \"8a58535b-8575-4b8c-90d2-ea08db7cdcc6\") "
Jul 06 20:02:28.894788 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894592    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a58535b-8575-4b8c-90d2-ea08db7cdcc6" (UID: "8a58535b-8575-4b8c-90d2-ea08db7cdcc6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 20:02:28.894788 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894639    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a58535b-8575-4b8c-90d2-ea08db7cdcc6" (UID: "8a58535b-8575-4b8c-90d2-ea08db7cdcc6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:28.894788 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894755    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a58535b-8575-4b8c-90d2-ea08db7cdcc6" (UID: "8a58535b-8575-4b8c-90d2-ea08db7cdcc6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:28.894945 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894879    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:02:28.894945 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894900    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-credential-socket\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:02:28.894945 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894915    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istiod-ca-cert\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:02:28.894945 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.894929    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-workload-certs\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:02:28.895215 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.895185    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a58535b-8575-4b8c-90d2-ea08db7cdcc6" (UID: "8a58535b-8575-4b8c-90d2-ea08db7cdcc6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:28.896561 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.896510    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a58535b-8575-4b8c-90d2-ea08db7cdcc6" (UID: "8a58535b-8575-4b8c-90d2-ea08db7cdcc6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 06 20:02:28.896561 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.896524    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-kube-api-access-t9djq" (OuterVolumeSpecName: "kube-api-access-t9djq") pod "8a58535b-8575-4b8c-90d2-ea08db7cdcc6" (UID: "8a58535b-8575-4b8c-90d2-ea08db7cdcc6"). InnerVolumeSpecName "kube-api-access-t9djq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:28.896819 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.896698    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a58535b-8575-4b8c-90d2-ea08db7cdcc6" (UID: "8a58535b-8575-4b8c-90d2-ea08db7cdcc6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 20:02:28.896994 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.896962    2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a58535b-8575-4b8c-90d2-ea08db7cdcc6" (UID: "8a58535b-8575-4b8c-90d2-ea08db7cdcc6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 20:02:28.995913 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.995880    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9djq\" (UniqueName: \"kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-kube-api-access-t9djq\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:02:28.995913 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.995912    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-podinfo\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:02:28.996126 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.995928    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-envoy\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:02:28.996126 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.995940    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-data\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:02:28.996126 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:28.995951    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a58535b-8575-4b8c-90d2-ea08db7cdcc6-istio-token\") on node \"ip-10-0-135-109.ec2.internal\" DevicePath \"\""
Jul 06 20:02:29.754085 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:29.754044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v" event={"ID":"8a58535b-8575-4b8c-90d2-ea08db7cdcc6","Type":"ContainerDied","Data":"c0d01e469ea82fee06d35eccfa8c0d37586c58845cbed8fb32cde5cb5d777638"}
Jul 06 20:02:29.754542 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:29.754100    2579 scope.go:117] "RemoveContainer" containerID="f7582973868021e7cfefe8cd7d67c8f5fe5c0c785892d8b6a6c0e364edf02a2f"
Jul 06 20:02:29.754542 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:29.754055    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"
Jul 06 20:02:29.780193 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:29.780165    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"]
Jul 06 20:02:29.783959 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:29.783935    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9cb33a-openshift-default-7bddd5dccf-wgd8v"]
Jul 06 20:02:30.099435 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:30.099407    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" path="/var/lib/kubelet/pods/8a58535b-8575-4b8c-90d2-ea08db7cdcc6/volumes"
Jul 06 20:02:31.041058 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:31.041010    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:31.139986 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:31.139956    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:31.318821 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:31.318727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:31.577372 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:31.577274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:36.661943 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:36.661908    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69bfdfb78f-5wtns_54c8b678-2605-45bb-9c5c-92b90bc806e1/maas-api/0.log"
Jul 06 20:02:36.768571 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:36.768540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722770-6n45d_cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac/cleanup/0.log"
Jul 06 20:02:36.872910 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:36.872882    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-ln79q_1957345a-0d0f-4461-b505-cf9fab8e40f2/cleanup/0.log"
Jul 06 20:02:36.980942 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:36.980854    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722800-fgprb_20eb212d-4d29-4d49-ae7e-76b1994d4510/cleanup/0.log"
Jul 06 20:02:37.108305 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:37.108256    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54c7c76bb-q2qsg_0fa3021b-f200-409f-870b-50c0bde5ead4/manager/0.log"
Jul 06 20:02:37.694598 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:37.694573    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69fd78d8d5-xp6g4_9c4f5dff-14f1-4911-aa17-db2d32856d4d/copy-manifests/0.log"
Jul 06 20:02:37.701906 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:37.701882    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69fd78d8d5-xp6g4_9c4f5dff-14f1-4911-aa17-db2d32856d4d/manager/0.log"
Jul 06 20:02:37.812410 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:37.812381    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-bvg2x_835aa2bb-6cd8-46c4-b318-8b646c9772ba/postgres/0.log"
Jul 06 20:02:39.309380 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:39.309348    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xwtpp_da2c37ff-a0aa-4181-b3b1-75205ce1ed45/manager/0.log"
Jul 06 20:02:39.419716 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:39.419687    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tnlwk_141b0ad9-aeef-4ef8-8874-6f366bbc03ab/kuadrant-console-plugin/0.log"
Jul 06 20:02:40.215004 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:40.214969    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xskmt_147d9857-131c-4000-8826-de067cae9f8a/istio-proxy/0.log"
Jul 06 20:02:40.340735 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:40.340689    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w8qlb_4626c5a2-2078-4afd-9ddd-373dd061d588/discovery/0.log"
Jul 06 20:02:40.446589 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:40.446561    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc75879f5-2skj2_381d400d-5ca7-41c0-8485-40c3c862a606/kube-auth-proxy/0.log"
Jul 06 20:02:40.679561 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:40.679520    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4bpp_6cd1f295-3fcb-437c-97d7-be47b0fd14d3/istio-proxy/1.log"
Jul 06 20:02:40.794682 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:40.794650    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-tgnw4_b8f637b5-a57d-4a52-b32b-a0c8e8f397dd/payload-pre-processing/0.log"
Jul 06 20:02:40.918963 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:40.918936    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qzzbp_56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4/payload-processing/0.log"
Jul 06 20:02:41.359899 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:41.359869    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-bnvmh_46ce160c-1879-43ad-b0f6-d350c8feb8af/main/0.log"
Jul 06 20:02:41.473293 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:41.473267    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-22x4d_09f9bc2e-c3f5-4170-86e0-a7500343445c/main/0.log"
Jul 06 20:02:41.810273 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:41.810188    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-bbnps_7c310a30-bd5a-4649-9b11-199c23002986/main/0.log"
Jul 06 20:02:41.919629 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:41.919599    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-qfbnn_1024fa76-eb50-4e6b-b556-921220e4fbd9/main/0.log"
Jul 06 20:02:45.896359 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:45.896319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:45.989994 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:45.989958    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:02:49.490267 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:49.490232    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sl8dp_23a01417-97d0-4c52-867c-dd9e9567ca4b/global-pull-secret-syncer/0.log"
Jul 06 20:02:49.551601 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:49.551563    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log"
Jul 06 20:02:49.697477 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:49.697449    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-109.ec2.internal_fc08615788179b892d68aba0ae981b36/haproxy/0.log"
Jul 06 20:02:54.941718 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:54.941670    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xwtpp_da2c37ff-a0aa-4181-b3b1-75205ce1ed45/manager/0.log"
Jul 06 20:02:54.970930 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:54.970900    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tnlwk_141b0ad9-aeef-4ef8-8874-6f366bbc03ab/kuadrant-console-plugin/0.log"
Jul 06 20:02:57.731536 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:57.731508    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vnh4n_64def843-4e84-4471-a054-8f3c73e20ce8/node-exporter/0.log"
Jul 06 20:02:57.757957 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:57.757935    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vnh4n_64def843-4e84-4471-a054-8f3c73e20ce8/kube-rbac-proxy/0.log"
Jul 06 20:02:57.785868 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:57.785839    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vnh4n_64def843-4e84-4471-a054-8f3c73e20ce8/init-textfile/0.log"
Jul 06 20:02:59.655762 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.655721    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-cg5xn_79e22465-0658-4141-8be5-524d8d74d6f6/networking-console-plugin/0.log"
Jul 06 20:02:59.739180 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739146    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"]
Jul 06 20:02:59.739505 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739492    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerName="istio-proxy"
Jul 06 20:02:59.739554 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739506    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerName="istio-proxy"
Jul 06 20:02:59.739554 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739518    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="284ac164-0fce-4b21-818d-760c79fc3a51" containerName="cleanup"
Jul 06 20:02:59.739554 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739524    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="284ac164-0fce-4b21-818d-760c79fc3a51" containerName="cleanup"
Jul 06 20:02:59.739554 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739532    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b0e8bc-4033-415a-a5ee-64ff40a0acf9" containerName="cleanup"
Jul 06 20:02:59.739554 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739537    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b0e8bc-4033-415a-a5ee-64ff40a0acf9" containerName="cleanup"
Jul 06 20:02:59.739781 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739556    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20eb212d-4d29-4d49-ae7e-76b1994d4510" containerName="cleanup"
Jul 06 20:02:59.739781 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739562    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="20eb212d-4d29-4d49-ae7e-76b1994d4510" containerName="cleanup"
Jul 06 20:02:59.739781 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739615    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerName="istio-proxy"
Jul 06 20:02:59.739781 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739622    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="20eb212d-4d29-4d49-ae7e-76b1994d4510" containerName="cleanup"
Jul 06 20:02:59.739781 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739629    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a58535b-8575-4b8c-90d2-ea08db7cdcc6" containerName="istio-proxy"
Jul 06 20:02:59.739781 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739635    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="284ac164-0fce-4b21-818d-760c79fc3a51" containerName="cleanup"
Jul 06 20:02:59.739781 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.739647    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b0e8bc-4033-415a-a5ee-64ff40a0acf9" containerName="cleanup"
Jul 06 20:02:59.744117 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.744097    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.746773 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.746746    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sxl92\"/\"kube-root-ca.crt\""
Jul 06 20:02:59.747650 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.747614    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sxl92\"/\"default-dockercfg-jrspn\""
Jul 06 20:02:59.747650 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.747634    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sxl92\"/\"openshift-service-ca.crt\""
Jul 06 20:02:59.761881 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.761858    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"]
Jul 06 20:02:59.784029 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.783994    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5tnd\" (UniqueName: \"kubernetes.io/projected/f60ee4f0-f42d-4a98-88e8-e866295c4850-kube-api-access-n5tnd\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.784155 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.784071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-lib-modules\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.784155 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.784100    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-sys\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.784155 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.784136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-proc\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.784310 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.784199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-podres\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.885360 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.885323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-lib-modules\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.885360 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.885358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-sys\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.885624 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.885439    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-sys\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.885624 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.885488    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-lib-modules\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.885624 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.885492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-proc\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.885624 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.885543    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-proc\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.885624 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.885548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-podres\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.885624 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.885596    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f60ee4f0-f42d-4a98-88e8-e866295c4850-podres\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.885624 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.885610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5tnd\" (UniqueName: \"kubernetes.io/projected/f60ee4f0-f42d-4a98-88e8-e866295c4850-kube-api-access-n5tnd\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:02:59.895391 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:02:59.895363    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5tnd\" (UniqueName: \"kubernetes.io/projected/f60ee4f0-f42d-4a98-88e8-e866295c4850-kube-api-access-n5tnd\") pod \"perf-node-gather-daemonset-6t5kt\" (UID: \"f60ee4f0-f42d-4a98-88e8-e866295c4850\") " pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:03:00.054185 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:00.054078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:03:00.196971 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:00.196945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"]
Jul 06 20:03:00.198761 ip-10-0-135-109 kubenswrapper[2579]: W0706 20:03:00.198732    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf60ee4f0_f42d_4a98_88e8_e866295c4850.slice/crio-12b4f52f6848830fa18a457787205e029b0d9d23cc0493870d3a48e85860703c WatchSource:0}: Error finding container 12b4f52f6848830fa18a457787205e029b0d9d23cc0493870d3a48e85860703c: Status 404 returned error can't find the container with id 12b4f52f6848830fa18a457787205e029b0d9d23cc0493870d3a48e85860703c
Jul 06 20:03:00.872722 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:00.872677    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-4t4lr_60b71e1f-756c-47b1-b29b-6dbb84f13586/download-server/0.log"
Jul 06 20:03:00.903359 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:00.903325    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt" event={"ID":"f60ee4f0-f42d-4a98-88e8-e866295c4850","Type":"ContainerStarted","Data":"92737e399782c6a6f1a32b0a9e64613a411f1eb8ba346f4cade068a498100eb4"}
Jul 06 20:03:00.903547 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:00.903382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt" event={"ID":"f60ee4f0-f42d-4a98-88e8-e866295c4850","Type":"ContainerStarted","Data":"12b4f52f6848830fa18a457787205e029b0d9d23cc0493870d3a48e85860703c"}
Jul 06 20:03:00.903547 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:00.903421    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:03:00.925607 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:00.925557    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt" podStartSLOduration=1.925540051 podStartE2EDuration="1.925540051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 20:02:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 20:03:00.922690884 +0000 UTC m=+2585.295172617" watchObservedRunningTime="2026-07-06 20:03:00.925540051 +0000 UTC m=+2585.298021783"
Jul 06 20:03:02.615425 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:02.615374    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pt8fk_8fd2e990-bc6f-4ac2-aa58-7de953608358/dns/0.log"
Jul 06 20:03:02.635285 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:02.635258    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pt8fk_8fd2e990-bc6f-4ac2-aa58-7de953608358/kube-rbac-proxy/0.log"
Jul 06 20:03:02.689697 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:02.689668    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kxxj8_f12a849a-9067-4be2-903b-f4e80b6c4bee/dns-node-resolver/0.log"
Jul 06 20:03:03.263907 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:03.263875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6497c8b9b8-qc6kp_8c120f2f-36c5-42c7-84cd-4b257540da41/registry/0.log"
Jul 06 20:03:03.358506 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:03.358457    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wbtx4_6811610c-2544-44eb-ac5b-8067dbacf3bb/node-ca/0.log"
Jul 06 20:03:04.431919 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:04.431890    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xskmt_147d9857-131c-4000-8826-de067cae9f8a/istio-proxy/0.log"
Jul 06 20:03:04.652675 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:04.652639    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w8qlb_4626c5a2-2078-4afd-9ddd-373dd061d588/discovery/0.log"
Jul 06 20:03:04.674987 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:04.674949    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc75879f5-2skj2_381d400d-5ca7-41c0-8485-40c3c862a606/kube-auth-proxy/0.log"
Jul 06 20:03:04.731193 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:04.731090    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4bpp_6cd1f295-3fcb-437c-97d7-be47b0fd14d3/istio-proxy/0.log"
Jul 06 20:03:04.784064 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:04.784033    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4bpp_6cd1f295-3fcb-437c-97d7-be47b0fd14d3/istio-proxy/1.log"
Jul 06 20:03:04.822620 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:04.822586    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-tgnw4_b8f637b5-a57d-4a52-b32b-a0c8e8f397dd/payload-pre-processing/0.log"
Jul 06 20:03:04.900654 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:04.900622    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qzzbp_56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4/payload-processing/0.log"
Jul 06 20:03:05.813187 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:05.813148    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-w5krb_328b6e75-67f1-459f-8b89-5065d5fffe19/serve-healthcheck-canary/0.log"
Jul 06 20:03:06.554763 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:06.554733    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxdtr_1918e148-d6fc-4023-9b40-e5de68ddea1c/kube-rbac-proxy/0.log"
Jul 06 20:03:06.576293 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:06.576264    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxdtr_1918e148-d6fc-4023-9b40-e5de68ddea1c/exporter/0.log"
Jul 06 20:03:06.599187 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:06.599153    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wxdtr_1918e148-d6fc-4023-9b40-e5de68ddea1c/extractor/0.log"
Jul 06 20:03:06.920154 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:06.920131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sxl92/perf-node-gather-daemonset-6t5kt"
Jul 06 20:03:09.223458 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.223430    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-69bfdfb78f-5wtns_54c8b678-2605-45bb-9c5c-92b90bc806e1/maas-api/0.log"
Jul 06 20:03:09.244918 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.244842    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722770-6n45d_cb2e1ce3-ea0f-44b3-abfc-039d80ee50ac/cleanup/0.log"
Jul 06 20:03:09.275370 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.275346    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722785-ln79q_1957345a-0d0f-4461-b505-cf9fab8e40f2/cleanup/0.log"
Jul 06 20:03:09.301968 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.301936    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29722800-fgprb_20eb212d-4d29-4d49-ae7e-76b1994d4510/cleanup/0.log"
Jul 06 20:03:09.466858 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.466825    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54c7c76bb-q2qsg_0fa3021b-f200-409f-870b-50c0bde5ead4/manager/0.log"
Jul 06 20:03:09.737472 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.737436    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xskmt_147d9857-131c-4000-8826-de067cae9f8a/istio-proxy/0.log"
Jul 06 20:03:09.831294 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.831268    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69fd78d8d5-xp6g4_9c4f5dff-14f1-4911-aa17-db2d32856d4d/manager/0.log"
Jul 06 20:03:09.858281 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.858236    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69fd78d8d5-xp6g4_9c4f5dff-14f1-4911-aa17-db2d32856d4d/copy-manifests/0.log"
Jul 06 20:03:09.890966 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.890934    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-bvg2x_835aa2bb-6cd8-46c4-b318-8b646c9772ba/postgres/0.log"
Jul 06 20:03:09.935773 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.935740    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w8qlb_4626c5a2-2078-4afd-9ddd-373dd061d588/discovery/0.log"
Jul 06 20:03:09.947508 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.947480    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc75879f5-2skj2_381d400d-5ca7-41c0-8485-40c3c862a606/kube-auth-proxy/0.log"
Jul 06 20:03:09.992915 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:09.992827    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4bpp_6cd1f295-3fcb-437c-97d7-be47b0fd14d3/istio-proxy/0.log"
Jul 06 20:03:10.048839 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:10.048806    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4bpp_6cd1f295-3fcb-437c-97d7-be47b0fd14d3/istio-proxy/1.log"
Jul 06 20:03:10.078726 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:10.078678    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-tgnw4_b8f637b5-a57d-4a52-b32b-a0c8e8f397dd/payload-pre-processing/0.log"
Jul 06 20:03:10.150355 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:10.150322    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qzzbp_56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4/payload-processing/0.log"
Jul 06 20:03:11.298715 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:11.298681    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4xskmt_147d9857-131c-4000-8826-de067cae9f8a/istio-proxy/0.log"
Jul 06 20:03:11.489229 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:11.489210    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-w8qlb_4626c5a2-2078-4afd-9ddd-373dd061d588/discovery/0.log"
Jul 06 20:03:11.563386 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:11.563354    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bc75879f5-2skj2_381d400d-5ca7-41c0-8485-40c3c862a606/kube-auth-proxy/0.log"
Jul 06 20:03:11.603444 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:11.603416    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4bpp_6cd1f295-3fcb-437c-97d7-be47b0fd14d3/istio-proxy/0.log"
Jul 06 20:03:11.657849 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:11.657813    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-b4bpp_6cd1f295-3fcb-437c-97d7-be47b0fd14d3/istio-proxy/1.log"
Jul 06 20:03:11.688261 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:11.688224    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-tgnw4_b8f637b5-a57d-4a52-b32b-a0c8e8f397dd/payload-pre-processing/0.log"
Jul 06 20:03:11.752558 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:11.752463    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-qzzbp_56e6e450-f2d8-4c51-b55d-bbbcfdac2cc4/payload-processing/0.log"
Jul 06 20:03:12.752981 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:12.752945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dr57n_de9436a0-5a95-46b4-bbbe-91f60647201f/konnectivity-agent/0.log" limit=1024
Jul 06 20:03:16.130117 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:16.130071    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bvdkl_3901c6da-4f8e-4299-9e93-3c1ce8214553/migrator/0.log"
Jul 06 20:03:16.152257 ip-10-0-135-109 kubenswrapper[2579]: I0706 20:03:16.152226    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-bvdkl_3901c6da-4f8e-4299-9e93-3c1ce8214553/graceful-termination/0.log"